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Preface to the Third Edition 


In contemplating the third edition, I have had multiple objectives to 
achieve. The first and foremost important objective is to maintain the ac- 
cessibility and readability of the book to a broad readership with varying 
mathematical backgrounds and sophistication. More proofs, more graphs, 
more explanations, and more applications are provided in this edition. 

The second objective is to update the contents of the book so that the 
reader stays abreast of new developments in this vital area of mathematics. 
Recent results on local and global stability of one-dimensional maps are 
included in Chapters 1, 4, and Appendices A and C. An extension of the 
Hartman—Grobman Theorem to noninvertible maps is stated in Appendix 
D. A whole new section on various notions of the asymptoticity of solutions 
and a recent extension of Perron’s Second Theorem are added to Chapter 
8. In Appendix E a detailed proof of the Levin-May Theorem is presented. 
In Chapters 4 and 5, the reader will find the latest results on the larval- 
pupal-adult flour beetle model. 

The third and final objective is to better serve the broad readership of 
this book by including most, but certainly not all, of the research areas 
in difference equations. As more work is being published in the Journal of 
Difference Equations and Applications and elsewhere, it became apparent 
that a whole chapter needed to be dedicated to this enterprise. With the 
prodding and encouragement of Gerry Ladas, the new Chapter 5 was born. 
Major revisions of this chapter were made by Fozi Dannan, who diligently 
and painstakingly rewrote part of the material and caught several errors 
and typos. His impact on this edition, particularly in Chapters 1, 4, and 
Chapter 8 is immeasurable and I am greatly indebted to him. My thanks 
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go to Shandelle Henson, who wrote a thorough review of the book and 
suggested the inclusion of an extension of the Hartman—Groman Theorem, 
and to Julio Lopez and his student Alex Sepulveda for their comments and 
discussions about the second edition. 

I am grateful to all the participants of the AbiTuMath Program and 
to its coordinator Andreas Ruffing for using the second edition as the 
main reference in their activities and for their valuable comments and dis- 
cussions. Special thanks go to Sebastian Pancratz of AbiTuMath whose 
suggestions improved parts of Chapters 1 and 2. I benefited from comments 
and discussions with Raghib Abu-Saris, Bernd Aulbach, Martin Bohner, 
Luis Carvahlo, Jim Cushing, Malgorzata Guzowska, Sophia Jang, Klara 
Janglajew, Nader Kouhestani, Ulrich Krause, Ronald Mickens, Robert 
Sacker, Hassan Sedaghat, and Abdul-Aziz Yakubu. It is a pleasure to thank 
Ina Lindemann, the editor at Springer-Verlag for her advice and support 
during the writing of this edition. Finally, I would like to express my deep 
appreciation to Denise Wilson who spent many weekends typing various 
drafts of the manuscript. Not only did she correct many glitches, typos, 
and awkward sentences, but she even caught some mathematical errors. 

I hope you enjoy this edition and if you have any comments or questions, 
please do not hesitate to contact me at selaydi@trinity.edu. 


San Antonio, Texas Saber N. Elaydi 
April 2004 


Suggestions for instructors using this book. 


The book may be used for two one-semester courses. A first course may 
include one of the following options but should include the bulk of the first 
four chapters: 


1. If one is mainly interested in stability theory, then the choice would 
be Chapters 1-5. 


2. One may choose Chapters 1—4, and Chapter 8 if the interest is to get 
to asymptotic theory. 


3. Those interested in oscillation theory may choose Chapters 1, 2, 3, 5, 
and 7. 


4. A course emphasizing control theory may include Chapters 1-3, 6, and 
10. 
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Chapter 1 
Y 
Chapter 2 
y 
Chapter 3 
y 
Chapter 4 
y 
Chapter 7 Chapter 6 Chapter 5 Chapter 6 
Chapter 9 Chapter 7 


The diagram above depicts the dependency among the chapters. 


Preface to the Second Edition 


The second edition has greatly benefited from a sizable number of com- 
ments and suggestions I received from users of the first edition. I hope 
that I have corrected all the errors and misprints in the book. Important 
revisions were made in Chapters 1 and 4. In Chapter 1, I added two ap- 
pendices (Global Stability and Periodic Solutions). In Chapter 4, I added 
a section on applications to mathematical biology. Influenced by a friendly 
and some not so friendly comments about Chapter 8 (previously Chapter 7: 
Asymptotic Behavior of Difference Equations), I rewrote the chapter with 
additional material on Birkhoff’s theory. Also, due to popular demand, a 
new chapter (Chapter 9) under the title “Applications to Continued Frac- 
tions and Orthogonal Polynomials” has been added. This chapter gives a 
rather thorough presentation of continued fractions and orthogonal poly- 
nomials and their intimate connection to second-order difference equations. 
Chapter 8 (Oscillation Theory) has now become Chapter 7. Accordingly, 
the new revised suggestions for using the text are as follows. 

The book may be used with considerable flexibility. For a one-semester 
course, one may choose one of the following options: 


(i) If you want a course that emphasizes stability and control, then you 
may select Chapters 1, 2, and 3, and parts of Chapters 4, 5, and 6. This 
is perhaps appropriate for a class populated by mathematics, physics, 
and engineering majors. 


(ii) If the focus is on the applications of difference equations to orthogonal 
polynomials and continued fractions, then you may select Chapters 1, 
2, 3, 8, and 9. 
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I am indebted to K. Janglajew, who used the book several times and 
caught numerous glitches and typos. I am very grateful to Julio Lopez 
and his students, who helped me correct some mistakes and improve the 
exposition in Chapters 7 and 8. I am thankful to Raghib Abu-Saris, who 
caught some errors and typos in Chapter 4. My thanks go to Gerry Ladas, 
who assisted in refining Chapter 8, and to Allan Peterson, who graciously 
used my book and caught some mistakes in Chapter 4. I thank my brother 
Hatem Elaydi who read thoroughly Chapter 6 and made valuable revisions 
in the exercises. Many thanks to Fozi Dannan, whose comments improved 
Chapters 1, 4, and 9. Ronald Mickens was always there for me when I 
needed support, encouragement, and advice. His impact on this edition is 
immeasurable. My special thanks to Jenny Wolkowicki of Springer-Verlag. 

I apologize in advance to all those whom I did not mention here but who 
have helped in one way or another to enhance the quality of this edition. 

It is my pleasure to thank my former secretary, Constance Garcia, who 
typed the new and revised material. 


San Antonio, Texas Saber N. Elaydi 
April 1999 


Preface to the First Edition 


This book grew out of lecture notes I used in a course on difference equa- 
tions that I have taught at Trinity University for the past five years. 
The classes were largely populated by juniors and seniors majoring in 
mathematics, engineering, chemistry, computer science, and physics. 

This book is intended to be used as a textbook for a course on difference 
equations at both the advanced undergraduate and beginning graduate 
levels. It may also be used as a supplement for engineering courses on 
discrete systems and control theory. 

The main prerequisites for most of the material in this book are calculus 
and linear algebra. However, some topics in later chapters may require some 
rudiments of advanced calculus and complex analysis. Since many of the 
chapters in the book are independent, the instructor has great flexibility in 
choosing topics for a one-semester course. 

This book presents the current state of affairs in many areas such as sta- 
bility, Ztransform, asymptoticity, oscillations, and control theory. However, 
this book is by no means encyclopedic and does not contain many impor- 
tant topics, such as numerical analysis, combinatorics, special functions 
and orthogonal polynomials, boundary value problems, partial difference 
equations, chaos theory, and fractals. The nonselection of these topics is 
dictated not only by the limitations imposed by the elementary nature of 
this book, but also by the research interest (or lack thereof) of the author. 

Great efforts were made to present even the most difficult material in 
an elementary format and to write in a style that makes the book acces- 
sible to students with varying backgrounds and interests. One of the main 
features of the book is the inclusion of a great number of applications in 
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economics, social sciences, biology, physics, engineering, neural networks, 
etc. Moreover, this book contains a very extensive and carefully selected 
set of exercises at the end of each section. The exercises form an integral 
part of the text. They range from routine problems designed to build ba- 
sic skills to more challenging problems that produce deeper understanding 
and build technique. The asterisked problems are the most challenging, and 
the instructor may assign them as long-term projects. Another important 
feature of the book is that it encourages students to make mathematical 
discoveries through calculator/computer experimentation. 

Chapter 1 deals with first-order difference equations, or one-dimensional 
maps on the real line. It includes a thorough and complete analysis of 
stability for many popular maps (equations) such as the logistic map, the 
tent map, and the Baker map. The rudiments of bifurcation and chaos 
theory are also included in Section 1.6. This section raises more questions 
and gives few answers. It is intended to arouse the reader’s interest in this 
exciting field. 

In Chapter 2 we give solution methods for linear difference equations of 
any order. Then we apply the obtained results to investigate the stability 
and the oscillatory behavior of second-order difference equations. At the 
end of the chapter we give four applications: the propagation of annual 
plants, the gambler’s ruin, the national income, and the transmission of 
information. 

Chapter 3 extends the study in Chapter 2 to systems of difference equa- 
tions. We introduce two methods to evaluate A” for any matrix A. In 
Section 3.1 we introduce the Putzer algorithm, and in Section 3.3 the 
method of the Jordan form is given. Many applications are then given 
in Section 3.5, which include Markov chains, trade models, and the heat 
equation. 

Chapter 4 investigates the question of stability for both scalar equations 
and systems. Stability of nonlinear equations is studied via linearization 
(Section 4.5) and by the famous method of Liapunov (Section 4.6). Our ex- 
position here is restricted to autonomous (time-invariant) systems. I believe 
that the extension of the theory to nonautonomous (time-variant) systems, 
though technically involved, will not add much more understanding to the 
subject matter. 

Chapter 5 delves deeply into Ztransform theory and techniques (Sections 
5.1, 5.2). Then the results are applied to study the stability of Volterra 
difference scalar equations (Sections 5.3, 5.4) and systems (Sections 5.5, 
5.6). For readers familiar with differential equations, Section 5.7 provides 
a comparison between the Ztransform and the Laplace transform. Most of 
the results on Volterra difference equations appear here for the first time 
in a book. 

Chapter 6 takes us to the realm of control theory. Here, we cover most 
of the basic concepts including controllability, observability, observers, 
and stabilizability by feedback. Again, we restrict the presentation to au- 
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tonomous (time-invariant) systems, since this is just an introduction to this 
vast and growing discipline. Moreover, most practitioners deal mainly with 
time-invariant systems. 

In Chapter 7 we give a comprehensive and accessible study of asymp- 
totic methods for difference equations. Starting from the Poincaré Theorem, 
the chapter covers most of the recent development in the subject. Section 
7.4 (asymptotically diagonal systems) presents an extension of Levinson’s 
Theorem to difference equations, while in Section 7.5 we carry our study to 
nonlinear difference equations. Several open problems are given that would 
serve as topics for research projects. 

Finally, Chapter 8 presents a brief introduction to oscillation theory. In 
Section 8.1, the basic results on oscillation for three-term linear difference 
equations are introduced. Extension of these results to nonlinear differ- 
ence equations is presented in Section 8.2. Another approach to oscillation 
theory, for self-adjoint equations, is presented in Section 8.3. Here we also 
introduce a discrete version of Sturm’s Separation Theorem. 

I am indebted to Gerry Ladas, who read many parts of the book and sug- 
gested many useful improvements, especially within the section on stability 
of scalar difference equations (Section 4.3). His influence through papers 
and lectures on Chapter 8 (oscillation theory) is immeasurable. My thanks 
go to Vlajko Kocic, who thoroughly read and made many helpful comments 
about Chapter 4 on Stability. Jim McDonald revised the chapters on the 
transform and control theory (Chapters 5 and 6) and made significant 
improvements. I am very grateful to him for his contributions to this book. 
My sincere thanks go to Paul Eloe, who read the entire manuscript and 
offered valuable suggestions that led to many improvements in the final 
draft of the book. I am also grateful to Istvan Gyori for his comments on 
Chapter 8 and to Ronald Mickens for his review of the whole manuscript 
and for his advice and support. I would like to thank the following math- 
ematicians who encouraged and helped me in numerous ways during the 
preparation of the book: Allan Peterson, Donald Bailey, Roberto Hasfura, 
Haydar Akca, and Shunian Zhang. I am grateful to my students Jeff Bator, 
Michelle MacArthur, and Nhung Tran, who caught misprints and mistakes 
in the earlier drafts of this book. My special thanks are due to my student 
Julie Lundquist, who proofread most of the book and made improvements 
in the presentation of many topics. My thanks go to Constance Garcia, who 
skillfully typed the entire manuscript with its many, many revised versions. 
And finally, it is a pleasure to thank Ina Lindemann and Robert Wexler 
from Springer-Verlag for their enthusiastic support of this project. 


San Antonio, Texas Saber N. Elaydi 
December 1995 
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Dynamics of First-Order 
Difference Equations 


1.1 Introduction 


Difference equations usually describe the evolution of certain phenomena 
over the course of time. For example, if a certain population has discrete 
generations, the size of the (n+ 1)st generation x(n +1) is a function of the 
nth generation x(n). This relation expresses itself in the difference equation 


x(n +1) = f(a(n)). (1.1.1) 


We may look at this problem from another point of view. Starting from a 
point xo, one may generate the sequence 


To, f(zo), f(f(xo)); f(f(f(xo))); IE 


For convenience we adopt the notation 


P (z0) = f(F(xo)), F(E) = F(F(F(x0))), ete. 


f (xo) is called the first iterate of zo under f; f?(xo) is called the second 
iterate of xo under f; more generally, f”(xo) is the nth iterate of zo under 
f. The set of all (positive) iterates {f"(ao) : n > 0} where f°(xo) = 
xo by definition, is called the (positive) orbit of xo and will be denoted 
by O(ao). This iterative procedure is an example of a discrete dynamical 
system. Letting x(n) = f” (xo), we have 


a(n +1) = f+! (z0) = f|” (£0) = f(x(n)), 


and hence we recapture (1.1.1). Observe that x(0) = f°(xo) = ao. For 
example, let f(x) = x? and x9 = 0.6. To find the sequence of iterates 
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{f"(ao)}, we key 0.6 into a calculator and then repeatedly depress the x? 
button. We obtain the numbers 


0.6, 0.36, 0.1296, 0.01679616,.... 


A few more key strokes on the calculator will be enough to convince the 
reader that the iterates f"(0.6) tend to 0. The reader is invited to verify 
that for all zo € (0,1), f” (xo) tends to 0 as n tends to oo, and that f”(zo) 
tends to oo if a9 ¢ [—1,1]. Obviously, f"(0) = 0, f” (1) = 1 for all positive 
integers n, and f"(—1) = 1 for n = 1,2,3,.... 

After this discussion one may conclude correctly that difference equa- 
tions and discrete dynamical systems represent two sides of the same coin. 
For instance, when mathematicians talk about difference equations, they 
usually refer to the analytic theory of the subject, and when they talk 
about discrete dynamical systems, they generally refer to its geometrical 
and topological aspects. 

If the function f in (1.1.1) is replaced by a function g of two variables, 
that is, g: Z+ x R > R, where Z* is the set of nonnegative integers and 
R is the set of real numbers, then we have 


a(n +1) = g(n, 2(n)). (1.1.2) 


Equation (1.1.2) is called nonautonomous or time-variant, whereas (1.1.1) 
is called autonomous or time-invariant. The study of (1.1.2) is much more 
complicated and does not lend itself to the discrete dynamical system 
theory of first-order equations. If an initial condition x(no) = £o is given, 
then for n > no there is a unique solution x(n) = x(n,no, zo) of (1.1.2) 
such that z(no, no, £o) = Xo. This may be shown easily by iteration. Now, 


x(n gy 1, no, £o) = g(no, z(no)) m g(No, Zo), 
x(no + 2, no, Lo) = g(no + 1, s(no + 1)) = g(no + 1, g(no, xo)), 
x(no + 3, no, Lo) = g(no + 2, x(no + 2)) = g[no + 2, g(no + 1, g(no, zo))]. 


And, inductively, we get x(n, no, zo) = g[n — 1, a(n — 1, no, zo)]. 


1.2 Linear First-Order Difference Equations 


In this section we study the simplest special cases of (1.1.1) and (1.1.2), 
namely, linear equations. A typical linear homogeneous first-order equation 
is given by 


z(n +1) = a(n)z(n), x(no) = Xo, n > no = 0, (1.2.1) 
and the associated nonhomogeneous equation is given by 
y(n +1) =a(n)y(n)+g(n),  y(no) =y = m2 20, (1.2.2) 


where in both equations it is assumed that a(n) # 0, and a(n) and g(n) 
are real-valued functions defined for n > no > 0. 
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One may obtain the solution of (1.2.1) by a simple iteration: 
x(no + 1) = a(no)x(no) = a(no) x0, 
(no + 2) = a(no + 1)a(no9 + 1) = a(no + 1)a(no)zo, 
x(no + 3) = a(no + 2)a(no + 2) = a(no + 2)a(no + L)a(no) ao. 


And, inductively, it is easy to see that 


x(n) = «(no +n — no)) 


= a(n — l)a(n — 2)-+-a(no) xo, 


x(n) = ji a) To. (1.2.3) 


i=Nno 


The unique solution of the nonhomogeneous (1.2.2) may be found as 
follows: 
y(no + 1) = a(no)yo + (no), 
y(no + 2) = a(no + 1)y(no + 1) + g(no + 1) 
= a(no + 1)a(no)yo + a(no + 1)g(no) + g(no + 1). 


Now we use mathematical induction to show that, for all n € Zt 


i= TI FO ES Tl a) 6@:|' (1.2.4) 
imni r=no Li=r+1 


To establish this, assume that formula (1.2.4) holds for n = k. Then from 
(1.2.2), y(k + 1) = a(k)y(k) + g(k), which by formula (1.2.4) yields 


k-1 k-1 k-1 
y(h + 1) = a(k) ji a(i)| w+ > kw TL a) I(r) + gh) 
: 1=No aa ae i=r+ 
=| [[ e@} w+) ( I] a0) g(r) 
ini r=no \i=r+1 


k 
+ ( II a0) g(k) (see footnote 1) 


i=k+1 
k k 
= | [[ a@| w+ (1 a0) g(r). 
i=no r=no \i=r+1 


Hence formula (1.2.4) holds for all n € Z+. 


‘Notice that we have adopted the notation [JE (i) = 1 and 


i=k+1 f 
k , 
eat a(i) = 0. 
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1.2.1 Important Special Cases 


There are two special cases of (1.2.2) that are important in many 
applications. The first equation is given by 


y(n +1) = ay(n)+g(n), y(0) = yo. (1.2.5) 


Using formula (1.2.4) one may establish that 


y(n) = a" yo + 3 a"—*l9(k). (1.2.6) 
k=0 


The second equation is given by 
y(n +1) =ay(n) +6,  y(0) = yo- (1.2.7) 
Using formula (1.2.6) we obtain 


a” —1 


"+d | ifaFl, 
a-l 


Yo + bn ifa= l1. 


y(n) = (1.2.8) 


Notice that the solution of the differential equation 


dx 
A ax(t), «(0) = zo, 
is given by 
a(t) = e% zo, 


and the solution of the nonhomogeneous differential equation 


ie 


ae ay(t) + g(t), y(0) = vo, 


is given by 


t 
y(t) = e%*yp + | elt) (5) ds. 
0 


Thus the exponential e® in differential equations corresponds to the expo- 
nential a” and the integral fe ets) g(s) ds corresponds to the summation 


n-1 
da" *19(k). 
k=0 
We now give some examples to practice the above formulas. 
Example 1.1. Solve the equation 


y(n + 1) = (nF Iy(n) + 2"(n+ DI, y(0) =1, n> 0. 
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TABLE 1.1. Definite sum. 


Number Summation Definite sum 
7 n(n + 1) 
1 Sok ea tates 
k=1 2 
e +1)(2n+1) 
2 Sok n(n + Qn +1) 
k=1 6 i 
3 Soke pe | 
k=1 2 
L 6nf + 15n? + 10n? — 1) 
4 kt n( 
= 30 
: Su (a”—1)/(a—1) ifa#1 
a n ifa=1 
é Sak (a”—a)/(a—1) ifa#1 
ame n—1 if a= 1 
7 —1)(n4+1)a"*!-— a"? +a 
7 ka", a#1 (a 
2 (a — 1)? 
Solution 
n-1 n-1 n-1 
y(n) = [G++ S50] [] G41] 2% +1) 
1=0 k=0 Li=k+1 
n-1 
=nl+ 5 n! 2* 


= 2”n! (from Table 1.1). 


Example 1.2. Find a solution for the equation 


a(n +1) = 2r(n) +3”, x(1) = 0.5. 


Solution From (1.2.6), we have 


m=i 
1 
a(n) = (5) OnE ae Se rR Lg 


k=1 


n-1 3 k 

= gn—-2 wifes gn-l = 
> (5) 
k=1 


n-1 
— 9n-2 n-13 (5) =i 
SE EE ( 3—1 


=3" 5.2072, 
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Example 1.3. A drug is administered once every four hours. Let D(n) be 
the amount of the drug in the blood system at the nth interval. The body 
eliminates a certain fraction p of the drug during each time interval. If the 
amount administered is Do, find D(n) and limpo D(n). 


Solution We first must create an equation to solve. Since the amount of 
drug in the patient’s system at time (n + 1) is equal to the amount at time 
n minus the fraction p that has been eliminated from the body, plus the 
new dosage Do, we arrive at the following equation: 

D(n+1) = (1 — p)D(n) + Do. 


Using (1.2.8), we solve the above equation, arriving at 


D D 
D(n) = [po J -p+ 2. 
p p 
Hence, 
D 
lim D(n) = 2. (1.2.9) 
noo Pp 


Let Do = 2 cubic centimeters (cc), p = 0.25. 
Then our original equation becomes 


D(n+1)=0.75D(n) +2,  D(0)=2. 
Table 1.2 gives D(n) for 0 <n < 10. 


It follows from (1.2.9) that lim,» D(n) = 8, where D* = 8cc is the 
equilibrium amount of drug in the body. We now enter the realm of finance 
for our next example. 


Example 1.4. Amortization 


Amortization is the process by which a loan is repaid by a sequence of 
periodic payments, each of which is part payment of interest and part 
payment to reduce the outstanding principal. 

Let p(n) represent the outstanding principal after the nth payment g(n). 
Suppose that interest charges compound at the rate r per payment period. 

The formulation of our model here is based on the fact that the out- 
standing principal p(n + 1) after the (n + 1)st payment is equal to the 
outstanding principal p(n) after the nth payment plus the interest rp(n) 
incurred during the (n + 1)st period minus the nth payment g(n). Hence 


p(n + 1) = p(n) + rp(n) — g(r), 


TABLE 1.2. Values of D(n). 


n 0 1 2 3 4 5 6 7 8 9 10 
D(n) | 2 | 3.5 | 4.62 | 5.47 | 6.1 | 6.58 | 6.93 | 7.2 | 7.4 | 7.55 | 7.66 
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or 
p(n+1)=(1+r)p(n)— g(r),  p(0) = po, (1.2.10) 
where po is the initial debt. By (1.2.6) we have 
n—-1 
p(n) = (1+r)"pp — X (1 + 7)" *"9(k). (1.2.11) 
k=0 


In practice, the payment g(n) is constant and, say, equal to T. In this case, 


p(n) =+)" 0+- (Z). (1.2.12) 


If we want to pay off the loan in exactly n payments, what would be the 
monthly payment T? Observe first that p(n) = 0. Hence from (1.2.12) we 
have 


r 
t= el aaa: 
Exercises 1.1 and 1.2 
1. Find the solution of each difference equation: 
(a) (n+ 1) — (n + 1)a(n) = 0, x(0) = c. 
(b) a(n + 1) — 3"2(n) = 0, x(0) =c. 
(c) (n+ 1) —e?"x(n) =0, x(0) =c. 
(d) x(n + 1) -— a(n) =0, n> 1, (1) =c. 
2. Find the general solution of each difference equation: 
(a) y(n+1)—Zy(n)=2,  y(0)=c. 
(b) y(n+1)- hula) =4, y) =e. 
3. Find the general solution of each difference equation: 
(a) y(n +1)- (n+1)y(n)=2(n+1)!, y0) =e. 
(b) y(n+1)=y(n) +e",  y(0) =c. 


4. (a) Write a difference equation that describes the number of regions 
created by n lines in the plane if it is required that every pair of 
lines meet and no more than two lines meet at one point. 


(b) Find the number of these regions by solving the difference equation 
in case (a). 


5. The gamma function is defined as T(x) = [5° t® te! dt, x > 0. 
(a) Show that r(x +1) = r(x), T(1) =1. 


8 


10. 


11. 


12. 


13. 


14. 
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(b) If n is a positive integer, show that T(n + 1) = nl. 


T(x+ 1) 


h h (n) — —1l)--:- = s 
(c) Show thata S aled erie 44) E a 


. A space (three-dimensional) is divided by n planes, nonparallel, and 


no four planes having a point in common. 


(a) Write a difference equation that describes the number of regions 
created. 


(b) Find the number of these regions. 


. Verify (1.2.6). 
. Verify (1.2.8). 
. A debt of $12,000 is to be amortized by equal payments of $380 at 


the end of each month, plus a final partial payment one month after 
the last $380 is paid. If interest is at an annual rate of 12% com- 
pounded monthly, construct an amortization schedule to show the 
required payments. 


Suppose that a loan of $80,000 is to be amortized by equal monthly 
payments. If the interest rate is 10% compounded monthly, find the 
monthly payment required to pay off the loan in 30 years. 


Suppose the constant sum T is deposited at the end of each fixed period 
in a bank that pays interest at the rate r per period. Let A(n) be the 
amount accumulated in the bank after n periods. 


(a) Write a difference equation that describes A(n). 


(b) Solve the difference equation obtained in (a), when A(0) = 0,T = 
$200, and r = 0.008. 


The temperature of a body is measured as 110° F. It is observed that 
the amount the temperature changes during each period of two hours 
is —0.3 times the difference between the previous period’s temperature 
and the room temperature, which is 70° F. 


(a) Write a difference equation that describes the temperature T(n) of 
the body at the end of n periods. 


(b) Find T(n). 


Suppose that you can get a 30-year mortgage at 8% interest. How much 
can you afford to borrow if you can afford to make a monthly payment 
of $1,000? 


Radium decreases at the rate of 0.04% per year. What is its half-life? 
(The half-life of a radioactive material is defined to be the time needed 
for half of the material to dissipate.) 


1.3 Equilibrium Points 9 


15. (Carbon Dating). It has been observed that the proportion of carbon- 
14 in plants and animals is the same as that in the atmosphere as long 
as the plant or the animal is alive. When an animal or plant dies, the 
carbon-14 in its tissue starts decaying at the rate r. 


(a) If the half-life of carbon-14 is 5,700 years, find r. 


(b) If the amount of carbon-14 present in a bone of an animal is 70% 
of the original amount of carbon-14, how old is the bone? 


1.3 Equilibrium Points 


The notion of equilibrium points (states) is central in the study of the dy- 
namics of any physical system. In many applications in biology, economics, 
physics, engineering, etc., it is desirable that all states (solutions) of a given 
system tend to its equilibrium state (point). This is the subject of study 
of stability theory, a topic of great importance to scientists and engineers. 
We now give the formal definition of an equilibrium point. 


Definition 1.5. A point x* in the domain of f is said to be an equilibrium 
point of (1.1.1) if it is a fixed point of f, i.e., f(a*) = a*. 


* 


In other words, x* is a constant solution of (1.1.1), since if x(0) = a* is 
an initial point, then x(1) = f(a*) = x*, and #(2) = f(a(1)) = f(a*) = 2%, 
and so on. 

Graphically, an equilibrium point is the x-coordinate of the point where 
the graph of f intersects the diagonal line y = x (Figures 1.1 and 1.2). For 
example, there are three equilibrium points for the equation 


a(n +1) = 2°(n) 


where f(x) = x°. To find these equilibrium points, we let f(a*) = x*, or 
x? = x, and solve for x. Hence there are three equilibrium points, —1,0, 1 
(Figure 1.1). Figure 1.2 illustrates another example, where f(x) = «?—x+1 


and the difference equation is given by 
a(n+1) = 27(n) —2(n) +1. 


Letting x? — x + 1 = z, we find that 1 is the only equilibrium point. 
There is a phenomenon that is unique to difference equations and cannot 
possibly occur in differential equations. It is possible in difference equations 
that a solution may not be an equilibrium point but may reach one after 
finitely many iterations. In other words, a nonequilibrium state may go to 
an equilibrium state in a finite time. This leads to the following definition. 


Definition 1.6. Let x be a point in the domain of f. If there exists a 
positive integer r and an equilibrium point x* of (1.1.1) such that f” (x) = 
x*, f’ (x) A x*, then z is an eventually equilibrium (fixed) point. 
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FIGURE 1.1. Fixed points of f(x) = 2°. 


f(x) eB 


x*=1 


FIGURE 1.2. Fixed points of f(x) = £z? — x +1. 


Example 1.7. The Tent Map 
Consider the equation (Figure 1.3) 
u(n+1) =T(2(n)), 


where 


There are two equilibrium points, 0 and 5 (see Figure 1.3). The search for 
eventually equilibrium points is not as simple algebraically. If «(0) = 


then z(1) = 3, 


a(2) = 1, and x(3) = 0. Thus ż is an eventually equilibrium 


point. The reader is asked to show that if x = k/2”, where k and n are 
positive integers with 0 < k/2” < 1, then x is an eventually equilibrium 


point (Exercises 1.3, Problem 15). 
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x(n) 


Oo 1 2 3 4 5 6 7 8 9 10 n 


FIGURE 1.4. Stable x*. If x(0) is within ô from x*, then a(n) is within € from 
x(n) for all n > 0. 


One of the main objectives in the study of a dynamical system is to 
analyze the behavior of its solutions near an equilibrium point. This study 


constitutes the stability theory. Next we introduce the basic definitions of 
stability. 


Definition 1.8. (a) The equilibrium point 2* of (1.1.1) is stable (Figure 
1.4) if given € > 0 there exists ô > 0 such that |r — 2*| < 6 implies 


|f” (£0) —2*| < for all n > 0. If z* is not stable, then it is called unstable 
(Figure 1.5). 


(b) The point x* is said to be attracting if there exists 7 > 0 such that 


|x(0) —a2*| <1 implies lim a(n) = z*. 


n— o0 


If 7 = œ, x* is called a global attractor or globally attracting. 
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x(n) 


01 2 3 4 5 6 7 8 9 10 


FIGURE 1.5. Unstable x*. There exists € > 0 such that no matter how close (0) 
is to *, there will be an N such that z(N) is at least € from 2*. 


x(n) 


1 2 3 4 5 6 7 8 9 10 n 


FIGURE 1.6. Asymptotically stable x*. Stable if x(0) is within 7 of x*; then 
limn- x(n) = 2*. 


(c) The point x* is an asymptotically stable equilibrium point if it is stable 
and attracting. 
If n = co, a* is said to be globally asymptotically stable (Figure 1.7). 


To determine the stability of an equilibrium point from the above def- 
initions may prove to be a mission impossible in many cases. This is due 
to the fact that we may not be able to find the solution in a closed form 
even for the deceptively simple-looking equation (1.1.1). In this section we 
present some of the simplest but most powerful tools of the trade to help 
us understand the behavior of solutions of (1.1.1) in the vicinity of equilib- 
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x(n) 
x,(0) 
vi 
x,(0) 1 2 3 4 56 7 8 9 10 n 


FIGURE 1.7. Globally asymptotically stable z*. Stable and limn— oo x(n) = 2* 
for all (0). 


rium points, namely, the graphical techniques. A hand-held calculator may 
fulfill all your graphical needs in this section. 


1.3.1 The Stair Step (Cobweb) Diagrams 


We now give, in excruciating detail, another important graphical method 
for analyzing the stability of equilibrium (and periodic) points for (1.1.1). 
Since z(n+ 1) = f(x(n)), we may draw a graph of f in the (a(n), z(n+1)) 
plane. Then, given x(0) = xo, we pinpoint the value x(1) by drawing a 
vertical line through zo so that it also intersects the graph of f at (xo, x(1)). 
Next, draw a horizontal line from (xo, £(1)) to meet the diagonal line y = x 
at the point (x(1),x(1)). A vertical line drawn from the point («(1), 7(1)) 
will meet the graph of f at the point (a(1),2(2)). Continuing this process, 
one may find x(n) for all n > 0. 


Example 1.9. The Logistic Equation 


Let y(n) be the size of a population at time n. If u is the rate of growth 
of the population from one generation to another, then we may consider a 
mathematical model in the form 


y(n + 1) = py(n), >o. (1.3.1) 


If the initial population is given by y(0) = yo, then by simple iteration we 
find that 


y(n) = Bh" Yo (1.3.2) 


is the solution of (1.3.1). If y > 1, then y(n) increases indefinitely, and 
limno y(n) = 00. If u = 1, then y(n) = yo for all n > 0, which means that 
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the size of the population is constant for the indefinite future. However, for 
u < 1, we have limpo y(n) = 0, and the population eventually becomes 
extinct. 


For most biological species, however, none of the above cases is valid as 
the population increases until it reaches a certain upper limit. Then, due 
to the limitations of available resources, the creatures will become testy 
and engage in competition for those limited resources. This competition is 
proportional to the number of squabbles among them, given by y?(n). A 
more reasonable model would allow b, the proportionality constant, to be 
greater than 0, 


y(n +1) = py(n) — by*(n). (1.3.3) 
If in (1.3.3), we let x(n) = ?y(n), we obtain 
s(n +1) = uz(n)(1 — z(n)) = f(e(n)). (1.3.4) 


This equation is the simplest nonlinear first-order difference equation, com- 
monly referred to as the (discrete) logistic equation. However, a closed-form 
solution of (1.3.4) is not available (except for certain values of u). In spite of 
its simplicity, this equation exhibits rather rich and complicated dynamics. 
To find the equilibrium points of (1.3.4) we let f(x*) = wa*(1 — 2*) = x*. 
Thus, we pinpoint two equilibrium points: x* = 0 and x* = (pu —1)/w. 

Figure 1.8 gives the stair step diagram of (x(n), x(n + 1)) when p = 2.5 
and x«(0) = 0.1. In this case, we also have two equilibrium points. One, 
x* = 0, is unstable, and the other, x* = 0.6, is asymptotically stable. 


Example 1.10. The Cobweb Phenomenon 
(Economics Application) 


Here we study the pricing of a certain commodity. Let S(n) be the number 
of units supplied in period n, D(n) the number of units demanded in period 
n, and p(n) the price per unit in period n. 

For simplicity, we assume that D(n) depends only linearly on p(n) and 
is denoted by 


D(n) =—map(n)+ba,  ma>0,  ba>0. (1.3.5) 


This equation is referred to as the price-demand curve. The constant mg 
represents the sensitivity of consumers to price. We also assume that the 
price-supply curve relates the supply in any period to the price one period 
before, i.e., 


S(n+1) = msp(n) + bs, ms > 0, bs > 0. (1.3.6) 


The constant m, is the sensitivity of suppliers to price. The slope of the 
demand curve is negative because an increase of one unit in price produces 
a decrease of mg units in demand. Correspondingly, an increase of one unit 
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x(n+1) 


A x(n) 


Xo x 


FIGURE 1.8. Stair step diagram for u = 2.5. 


in price causes an increase of m, units in supply, creating a positive slope 
for that curve. 

A third assumption we make here is that the market price is the price 
at which the quantity demanded and the quantity supplied are equal, that 
is, at which D(n + 1) = S(n +1). 


Thus 
—map(n + 1) + ba = msp(n) + bs, 
or 
p(n + 1) = Ap(n) + B = f(p(n)), (1.3.7) 
where 
a. suck (1.3.8) 
Ma Mad 


This equation is a first-order linear difference equation. The equilibrium 
price p* is defined in economics as the price that results in an intersection 
of the supply S(n + 1) and demand D(n) curves. Also, since p* is the 
unique fixed point of f(p) in (1.3.7), p* = B/(1 — A). (This proof arises 
later as Exercises 1.3, Problem 6.) Because A is the ratio of the slopes of 
the supply and demand curves, this ratio determines the behavior of the 
price sequence. There are three cases to be considered: 


(a) -l1<A<0, 
(c) A< -1. 


The three cases are now depicted graphically using our old standby, the 
stair step diagram. 
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p(n+1) 


Pe p(n) 


FIGURE 1.9. Asymptotically stable equilibrium price. 


p(n+1) 


X 
Z 


FIGURE 1.10. Stable equilibrium price. 


p(n) 


(i) In case (a), prices alternate above and below but converge to the equi- 
librium price p*. In economics lingo, the price p* is considered “stable” ; 
in mathematics, we refer to it as “asymptotically stable” (Figure 1.9). 


(ii) In case (b), prices oscillate between two values only. If p(0) = po, then 
p(1) = —po +B and p(2) = po. Hence the equilibrium point p* is stable 
(Figure 1.10). 


(iii) In case (c), prices oscillate infinitely about the equilibrium point p* 
but progressively move further away from it. Thus, the equilibrium 
point is considered unstable (Figure 1.11). 
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FIGURE 1.11. Unstable equilibrium price. 


An explicit solution of (1.3.7) with p(0) = po is given by 
TE Po) ah maias Poia a8) 
P\) = | Po - I-A ILA xercises 1.9, F robilem . 9. 


This explicit solution allows us to restate cases (a) and (b) as follows. 


1.3.2 The Cobweb Theorem of Economics 


If the suppliers are less sensitive to price than the consumers (i.e., Ms < 
mg), the market will then be stable. If the suppliers are more sensitive than 
the consumers, the market will be unstable. 

One might also find the closed-form solution (1.3.9) by using a computer 
algebra program, such as Maple. One would enter this program: 


rsolve({p(n + 1) = a * p(n) + b, p(0) = po}, p(n)). 
Exercises 1.3 
1. Contemplate the equation z(n + 1) = f(x(n)), where f(0) = 0. 


(a) Prove that x(n) = 0 is a solution of the equation. 


(b) Show that the function depicted in the following (n, x(n)) diagram 
cannot possibly be a solution of the equation: 
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x(n) 


1 2 3 4 5 


2. (Newton’s Method of Computing the Square Root of a Positive 


Number) 
The equation x? = a can be written in the form z = 4 (x + a/z). This 
form leads to Newton’s method 


a(n +1) = I [ec + a . 


2 


x(n) 
(a) Show that this difference equation has two equilibrium points, —\/a 
and vya. 
(b) Sketch a stair step diagram for a = 3,2(0) = 1, and x(0) = —1. 
(c) What can you conclude from (b)? 


. (Pielou’s Logistic Equation) 


E.C. Pielou [119] referred to the following equation as the discrete 
logistic equation: 
ax(n) 


(a) Find the positive equilibrium point. 


(b) Demonstrate, using the stair step diagram, that the positive equi- 
librium point is asymptotically stable, taking a = 2 and ĝ = 
1. 


. Find the equilibrium points and determine their stability for the 


equation 
6 


see 


. (a) Draw a stair step diagram for (1.3.4) for u = 0.5, 3, and 3.3. What 


can you conclude from these diagrams? 


(b) Determine whether these values for u give rise to periodic solutions 
of period 2. 


. (The Cobweb Phenomenon [equation (1.3.7)]). Economists define the 


equilibrium price p* of a commodity as the price at which the demand 
function D(n) is equal to the supply function S(n + 1). These are 
defined in (1.3.5) and (1.3.6), respectively. 


( 


10. 


11. 
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a) Show that p* = —8,, where A and B are defined as in (1.3.8). 
I-A 


(b) Let m, = 2, bs = 3, mg = 1, and bg = 15. Find the equilibrium 
price p*. Then draw a stair step diagram, for p(0) = 2. 


. Continuation of Problem 6: 


Economists use a different stair step diagram, as we will explain in the 
following steps: 


(i) Let the x-axis represent the price p(n) and the y-axis represent 
S(n +1) or D(n). Draw the supply line and the demand line and 
find their point of intersection p*. 


(ii) Starting with p(0) = 2 we find s(1) by moving vertically to the 
supply line, then moving horizontally to find D(1) (since D(1) = 
S(1)), which determines p(1) on the price axis. The supply S(2) 
is found on the supply line directly above p(1), and then D(2) (= 
S(2)) is found by moving horizontally to the demand line, etc. 


iii) Is p* stable? 


. Repeat Exercises 6 and 7 for: 


(a) Ms = Mma = 2, ba = 10, and b, = 2. 


(b) Ms 1, Maq 2, ba 14, and bs = 


. Verify that formula (1.3.9) is a solution of (1.3.7). 


Use formula (1.3.9) to show that: 
(a) If —1 < A < 0, then limps p(n) = B/1 — A. 
(b) If A < —1, then p(n) is unbounded. 
(c) If A = —1, then p(n) takes only two values: 
p(0) if n is even, 
(n) = Ak 
pil) = B-— po if nis odd. 


Suppose that the supply and demand equations are given by D(n) = 
—2p(n) + 3 and S(n+1) = p(n) +1. 


(a) Assuming that the market price is the price at which supply equals 
demand, find a difference equation that relates p(n + 1) to p(n). 


(b) Find the positive equilibrium value of this equation. 


(c) Use the stair step diagrams to determine the stability of the positive 
equilibrium value. 
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12. Consider Baker’s map defined by 


1 

2x fr 0< z< =, 

B(x) = ; 2 
2r—1 forz=<a<l. 


2 
(i) Draw the function B(x) on [0,1]. 


(ii) Show that x € [0,1] is an eventually fixed point if and only if it is 
of the form x = k/2", where k and n are positive integers,” with 
O0<k<2"-1. 


13. Find the fixed points and the eventually fixed points of z(n + 1) = 
f(x(n)), where f(x) = x°. 


14. Find an eventually fixed point of the tent map of Example 1.7 that is 
not in the form k/2”. 


15. Consider the tent map of Example 1.7. Show that if x = k/2”, where k 
and n are positive integers with 0 < k/2” < 1, then x is an eventually 
fixed point. 


1.4 Numerical Solutions of Differential Equations 


Differential equations have been extensively used as mathematical models 
for a wide variety of physical and artificial phenomena. Such models de- 
scribe populations or objects that evolve continuously in which time (or the 
independent variable) is a subset of the set of real numbers. In contrast, 
difference equations describe populations or objects that evolve discretely 
in which time (or the independent variable) is a subset of the set of integers. 
In many instances, one is unable to solve a given differential equation. In 
this case, we need to use a numerical scheme to approximate the solutions 
of the differential equations. A numerical scheme leads to the construction 
of an associated difference equation that is more amenable to computation 
either by a graphing-held calculator or by a computer. Here we present a 
couple of simple numerical schemes. We begin by Euler’s method, one of 
the oldest numerical methods. 


1.4.1 Euler’s Method 


Consider the first-order differential equation 


x'(t) = g(t, x(t), x(to) = Xo, to <t<b. (1.4.1) 


2A number v € [0,1] is called a dyadic rational if it has the form k/2” for 
some nonnegative integers k and n, with 0 < k < 2” — 1. 
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Let us divide the interval [tọ,b] into N equal subintervals. The size of 
each subinterval is called the step size of the method and is denoted by 
h = (b — to)/N. This step size defines the nodes to,t1,t2,...,tn, where 
tj = to + jh. Euler’s method approximates w(t) by (a(t + h) — x(t))/h. 
Substituting this value into (1.4.1) gives 
u(t +h) = x(t) + hg(t, x(t), 

and for t = to + nh, we obtain 

alto + (n+ Lh] = z(to + nh) + hg[to + nh, «(to + nh)] (1.4.2) 


for n = 0,1,2,..., N — 1. 
Adapting the difference equation notation and replacing z(to + nh) by 
x(n) gives 


a(n+ 1) = a(n) + hgn, x(n). (1.4.3) 


Equation (1.4.3) defines Euler’s algorithm, which approximates the solu- 
tions of the differential equation (1.4.1) at the node points. 

Note that x* is an equilibrium point of (1.4.3) if and only if g(a*) = 0. 
Thus the differential equation (1.4.1) and the difference equation (1.4.3) 
have the same equilibrium points. 


Example 1.11. Let us now apply Euler’s method to the differential 
equation: 


a’ (t) = 0.7? (t)+0.7, a(0)=1,  t€([0,1}) (DEB) (see footnote 3). 


Using the separation of variable method, we obtain 
1 dx 
— | ~— = | dt. 
0.7 / «241 / 


tan +(a(t)) = 0.7t+ c. 


Hence 


Letting «(0) = 1, we get c= 7. Thus, the exact solution of this equation 
is given by a(t) = tan (0.7t + 4). 
The corresponding difference equation using Euler’s method is 


a(n+1)=a(n)+0.7h(a?(n) +1),  2(0)=1 (AB) (see footnote 4) 


Table 1.3 shows the Euler approximations for h = 0.2 and 0.1, as well as 
the exact values. Figure 1.12 depicts the (n, x(n)) diagram. Notice that the 
smaller the step size we use, the better the approximation we have. 


3 DE = differential equation. 
“AE = difference equation. 
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TABLE 1.3. 
(AE) Euler | (AF) Euler 
(h = 0.2) (h=0.1) | Exact (DE) 

n t x(n) x(n) x(t) 
0 1 1 1 

1 | 0.1 1.14 1.150 
2 | 0.2 1.28 1.301 1.328 
3 | 0.3 1.489 1.542 
4 | 0.4 1.649 1.715 1.807 
5 | 0.5 1.991 2.150 
6 | 0.6 2.170 2.338 2.614 
7 | 0.7 2.791 3.286 
8 | 0.8 2.969 3.406 4.361 
9 | 0.9 4.288 6.383 
10 1 4.343 5.645 11.681 


Exact 


0.1 0.15 0.2 0.25 0.3 0.35 0.4 0.45 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1.0 t 


FIGURE 1.12. The (n,x(n)) diagram. 


Example 1.12. Consider the logistic differential equation 
x(t) = az(t)(1 — x(t)), (0) = zo. 


The equilibrium points (or constant solutions) are obtained by letting 
x'(t) = 0. Hence az(1 — x) = 0 and we then have two equilibrium points 
xi = 0 and x5 = 1. The exact solution of the equation is obtained by 
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separation of variables, 


Hence 


bet 
a= I 


Now 2(0) = zo = 1 gives b = 7%. Substituting in x(t) yields 


_ 


To ett zoe% 


I= rot zoe  1+zo(e— 1) 


x(t) 


Ifa > 0, jim x(t) = 1, and thus all solutions converge to the equilibrium 
— 00 
point x} = 1. On the other hand, if a < 0, Jm x(t) = 0, and thus all 
= oo 


solutions converge to the equilibrium point 2} = 0. 
Let us now apply Euler’s method to the logistic differential equation. 
The corresponding difference equation is given by 


x(n +1) = z(n)+ haz(n)(1 — z(n)), x(0) = xo. 


This equation has two equilibrium points xj] = 0, 73 = 1 as in the 
differential equation case. 
Let y(n) = “*2(n). Then we have 


“~~ 1+ha 
y(n +1) = (1 + hajy(n)(1 — y(n)) 


x(t) 


Xo 


Xo t7 


FIGURE 1.13. If a > 0, all solutions with zo > 0 converge to 75 = 1. 
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x(t) 


Xo 


1 


FIGURE 1.14. If a < 0, all solutions with £o < 1 converge to xï = 0. 


or 
(m+1)= uyn) -yln)), y0)=—“*-2(0), and p=1+h 
y(n = py(n y(n), yO) = pO and u= a. 
The corresponding equilibrium points are yj = 0 and y3 = pad i n 


which correspond to xý = 0 and «3 = 1, respectively. Using the Cobweb 
diagram, we observe that for 1 < u < 3 (0 < ha < 2), all solutions 
whose initial point yo in the interval (0,1) converge to the equilibrium point 
y= ihe (Figure 1.15) and for 0 < u < 1 (—1 < ha < 0), all solutions 
whose initial point yo in the interval (0,1) converge to the equilibrium 
point y3 = 0 (Figure 1.16). However, for > 3 (ha > 2), almost all 
solutions where initial points are in the interval (0,1) do not converge to 
either equilibrium point yï or y3. In fact, we will see in later sections that 
for u > 3.57 (ha > 2.57), solutions of the difference equation behave in a 
“chaotic” manner (Figure 1.17). In the next section we will explore another 
numerical scheme that has been proven effective in a lot of cases [100]. 


1.4.2 A Nonstandard Scheme 


Consider again the logistic differential equation. Now if we replace x?(n) 
in Euler’s method by x(n)a(n + 1) we obtain 


x(n+1)=2(n) + haz(n) — hax(n)x(n + 1). 


Simplifying we obtain the rational difference equation 


i = (1 + ha)x(n) 
EES 1+ haz(n) 
or 
l a ax(n) 
TD Ba) 


with a = 1 + ha, 8 =a — 1 = ha. 
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A x(n+1) 


FIGURE 1.15. 0 < ha < 2. 


x(n+1) 


0.5 J 


FIGURE 1.16. —1 < ha < 0. 


This equation has two equilibrium points x} = 0 and z3 = 1. From the 
Cobweb diagram (Figure 1.18) we conclude that Jim, a(n) =lifa>l. 

Since h > 0, a > 1 if and only if a > 0. Thus “all “solutions converge to 
the equilibrium point x3 = 1 if a > 0 as in the differential equation case 
regardless of the size of h. 
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A 
x(n+1) 


0.5 _| 1 


> x(n) 


FIGURE 1.17. ha > 2.57. 


FIGURE 1.18.a@=1+ha, @=a-—1=ha. 


Exercises 1.4 

In Problems 1-5 
(a) Find the associated difference equation. 
(b) Draw an (n,y(n)) diagram. 


(c) Find, if possible, the exact solution of the differential equation and 
draw its graph on the same plot as that drawn in part in (b). 


10. 


11. 


S g e w Ne 
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-y =y +2,  y(0O))=3 OStS1, h=0.25. 


. Use a nonstandard numerical method to find the associated difference 


equation of the differential equation in Problem 1. 


. Do Problem 4 using a nonstandard numerical method and compare 


your results with Euler’s method. 


. Do Problem 5 using a nonstandard numerical method and compare 


your result with Euler’s method. 


. Use both Euler’s method and a nonstandard method to discretize the 


differential equation 
y (t)=y° +t, yO)=1, O<t<1, h=02. 


Draw the n — y(n) diagram for both methods. Guess which method 
gives a better approximation to the differential equation. 


(a) Use the Euler method with h = 0.25 on [0,1] to find the value of y 
corresponding to t = 0.5 for the differential equation 


dy 
Qt+ 0) =1. 
dt Y, y(0) 
(b) Compare the result obtained in (a) with the exact value. 


Given the differential equation of Problem 10, show that a better 
approximation is given by the difference equation 


y(n +1) = y(n) + Shly(n) +y/(n-+ 1). 


This method is sometimes called the modified Euler method. 


1.5 Criterion for the Asymptotic Stability 


of Equilibrium Points 


In this section we give a simple but powerful criterion for the asymptotic 
stability of equilibrium points. The following theorem is our main tool in 
this section. 


Theorem 1.13. Let x* be an equilibrium point of the difference equation 


a(n +1) = f(x(n)), (1.5.1) 
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where f is continuously differentiable at x*. The following statements then 
hold true: 


(i) If |f'(@*)| <1, then x* is asymptotically stable. 
(ii) If |f'(@*)| > 1, then x* is unstable. 
PROOF. 


(i) Suppose that |f’(2*)| < M < 1. Then there is an interval J = (x*—y, 
x*+y) containing x* such that |f’ (x)| < M < 1 for all x € J. For if 
not, then for each open interval I„ = («* — +, 2* + 4) (for large n) there 
is a point £n € In such that |f’(a,)| > M. As n > œ, £n > x*. Since 
f’ is a continuous function, it follows that 


: 1 _ fl 
Jim f (tn) = f'(z*). 
Consequently, 
M < lim |f’ (zn) = |f'(2*°)| < M, 


which is a contradiction. This proves our statement. For x(0) € J, we 
have 


le(1) — #*| = |f(e@)) — f(a"). 


By the Mean Value Theorem, there exists € between z(0) and a* such 
that 


| F(2(0)) = F] = IFE le(0) — a*l. 

Thus 

|f(x(0)) — 2*| < M|x(0) — z*]. 
Hence 

|a(1) — a*| < M|x(0) — 2*|. (1.5.2) 

Since M < 1, inequality (1.5.2) shows that x(1) is closer to x* than 
x(0). Consequently, x(1) € J. 
By induction we conclude that 

|z(n) — 2*| < M"|x(0) — 2*|. 


For e > 0 we let ô = 557. Thus |2(0) — 2*| < 6 implies that |a(n) — 
x*| < £ for all n > 0. This conclusion suggests stability. Furthermore, 
limp—oo |z(n) — x*| = 0, and thus limpo a(n) = x*; we conclude 
asymptotic stability. 


The proof of part (ii) is left as Exercises 1.5, Problem 11. 


Remark: In the literature of dynamical systems, the equilibrium point «* 
is said to be hyperbolic if | f’(a*)| 4 1. 
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x(2) x(1) Xo 


FIGURE 1.19. Newton’s method. 


Example 1.14. The Newton-Raphson Method 


The Newton-Raphson method is one of the most famous numerical meth- 
ods for finding the roots of the equation g(x) = 0, where g(x) is continually 
differentiable (i.e., its derivative exists and is continuous). 

Newton’s algorithm for finding a zero x* of g(x) is given by the difference 
equation 


g(a(n)) 


enti) = a") a) 


(1.5.3) 


where x(0) = zo is your initial guess of the root x*. Here f(x) = x — ae 

Note first that the zero x* of g(x) is also an equilibrium point of (1.5.3). 
To determine whether Newton’s algorithm provides a sequence {x(n)} that 
converges to x* we use Theorem 1.13: 

1(m)]2 — ala) a! (or 
e-h- LER- | _ 9 
[g' (x*)] 

since g(x*) = 0. By Theorem 1.13, limno x(n) = x* if x(0) = zo is close 
enough to x* and g'(x*¥) 40. 


Observe that Theorem 1.13 does not address the nonhyperbolic case 
where | f’(2*)| = 1. Further analysis is needed here to determine the sta- 
bility of the equilibrium point x*. Our first discussion will address the case 
where f’(a*) = 1. 


Theorem 1.15. Suppose that for an equilibrium point «* of (1.5.1), 
f'(a*) =1. The following statements then hold: 


(i) If f’(x*) £0, then x* is unstable. 
(ii) If f’(a*) =0 and f'"(x*) > 0, then x* is unstable. 
(iii) If f” (x¥) =0 and f’'"(x*) < 0, then x* is asymptotically stable. 
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FIGURE 1.21. Unstable. f”(x*) < 0 (semistable from the right). 


PROOF. 

(i) If f” (x*) A 0, then the curve y = f(x) is either concave upward if 
f” (x*) > 0 or concave downward if f”(x*) < 0, as shown in Figures 1.20, 
1.21, 1.22, 1.23. If f”(a*) > 0, then f'(x) > 1 for all x in a small interval 
I = (x*,x* +£). Using the same proof as in Theorem 1.13, it is easy to show 
that «* is unstable. On the other hand, if f”(x*) < 0, then f'(x) > 1 for 
all x in a small interval I = (x* — ¢,x*). Hence x* is again unstable. 
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FIGURE 1.22. Unstable. f’(x*) = 1, f”(x*) = 0, and f” (x*) > 0. 


x(n+1) 


x(n) 
x(0) x* x(0) 


FIGURE 1.23. Asymptotically stable. f’(x*) =1, f”(x*) =0, and f” (x*) < 0. 


Proofs of parts (ii) and (iii) remain for the student’s pleasure as Exercises 
1.5, Problem 14. 

We now use the preceding result to investigate the case f’(#*) = —1. 

But before doing so, we need to introduce the notion of the Schwarzian 
derivative of a function f: 


Sf(x) 


=F Fel 
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Note that if f’/(2*) = —1, then 


Sf(a*) = —f"(a") — EN 


Theorem 1.16. Suppose that for the equilibrium point x* of (1.1.1), 
f'(a*) = —1. The following statements then hold: 


(i) If Sf(x*) <0, then x* is asymptotically stable. 
(ii) If Sf(x*) > 0, then x* is unstable. 
PROOF. Contemplate the equation 
y(n +1) = g(y(n)), where g(y) = f*(y). (1.5.4) 


We will make two observations about (1.5.4). First, the equilibrium point 
x* of (1.1.1) is also an equilibrium point of (1.5.4). Second, if x* is asymp- 
totically stable (unstable) with respect to (1.5.4), then it is so with respect 
to (1.1.1). (Why?) (Exercises 1.5, Problem 12.) Now, 


d 


© gly) = © HF) = POOO): 
y y 


Thus Lya) = [f’(x*)]? = 1. Hence Theorem 1.15 applies to this 
y 
d2 
situation. We need to evaluate gas”) : 
y 


Falo) = FIO) = PEONO 


= [PUPE +O U) 
Hence 
d2 
Now, Theorem 1.15 [parts (ii) and (iii)] tells us that the asymptotic stability 
of x* is determined by the sign of [g(x*)]’”. Using the chain rule again, one 
may show that 


Lg)” = -28 (2*) = 3" P. (1.5.5) 


(The explicit proof with the chain rule remains as Exercises 1.5, Problem 
13.) This step rewards us with parts (i) and (ii), and the proof of the 
theorem is now complete. 


Example 1.17. Consider the difference equation z(n+1) = z?(n)+3x(n). 
Find the equilibrium points and determine their stability. 

Solution The equilibrium points are 0 and —2. Now, f'(x) = 2x + 3. 
Since f’(0) = 3, it follows from Theorem 1.13 that 0 is unstable. Now, 
f'(—2) = —1, so Theorem 1.16 applies. Using (1.5.5) we obtain —2 f’” (—2)— 
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x(n+1) 


FIGURE 1.24. Stair step diagram for a(n + 1) = x° (n) + 32(n). 


3[f”(—2)|? = —12 < 0. Theorem 1.16 then declares that the equilibrium 
point —2 is asymptotically stable. Figure 1.24 illustrates the stair step 
diagram of the equation. 


Remark: One may generalize the result in the preceding example to a gen- 
eral quadratic map Q(x) = ax? + br + c,a 4 0. Let x* be an equilibrium 
point of Q(x), i.e., Q(a*) = x*. Then the following statements hold true. 
(i) If Q’(a*) = —1, then by Theorem 1.16, the equilibrium point x* is 
asymptotically stable. In fact, there are two equilibrium points for Q(x); 


xi = [(1 — b) (b — 1)? — 4ac] /2a; 
x = [(1 — b) + y (b — 1)? — 4ac] /2a. 


It is easy to see that Q’(xt) = —1, if (b—1)? = 4ac+4 and Q’(x3) # —1. 
Thus zł is asymptotically stable if (b — 1)? = 4ac + 4 (Exercises 1.5, 
Problem 8). 


(ii) If Q’(a*) = 1, then by Theorem 1.15, x* is unstable. In this case, we 
have only one equilibrium point «* = (1 — 6)/2a. Thus, x* is unstable 
if (b — 1)? = dae. 


Remark: 


(i) Theorem 1.15 fails if for a fixed point a*, f'(x*) = 1, f"(a*) = 
f'"(a*) =0. For example, for the map f(x) = x +(x—1)4 and its fixed 
point 2* = 1, f'(a*) = 1, f(x") = f" (a) = 0, and f(c*) = 24 > 0. 


(ii) Theorem 1.16 fails if f’(a*) = —1, and Sf(x*) = 0. This may be 
illustrated by the function f(a) = —x + 2x? —42°. For the fixed x* = 0, 
f'(a*) = -1, and Sf(a*) = 0. 
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In Appendix A, we present the general theory developed by Dannan, 
Elaydi, and Ponomarenko in 2003 [30]. The stability of the fixed points in 
the above examples will be determined. 


Exercises 1.5 


In Problems 1 through 7, find the equilibrium points and determine their 
stability using Theorems 1.13, 1.15, and 1.16. 


L. a(n +1) = 3[x°%(n) + z(n)]. 

2. e(n +1) =x?(n)+ 4 

3. e(n +1) = tan! z(n) 

4. x(n +1) =2?(n) 

i GGG eae) 

6. x(n+1)= ee a>landB>0. 
7. 2(n+1) = —#3(n) — 2(n). 


8. Let Q(x) = ax? +br +c, a Æ 0, and let x* be a fixed point of Q. Prove 
the following statements: 


(i) If Q’(a*) = —1, then 2* is asymptotically stable. Then prove the 
rest of Remark (i). 


(ii) If Q’(a*) = 1, then x* is unstable. Then prove the rest of Remark 
(ii). 
9. Suppose that in (1.5.3), g(a*) = g'(x*) = 0 and g”(x*) Æ 0. Prove 
that x* is an equilibrium point of (1.5.3). 
10. Prove Theorem 1.13, part (ii). 


11. Prove that if 2* is an equilibrium point of (1.5.1), then it is an equi- 
librium point of (1.5.1). Show also that the converse is false in general. 
For what class of maps f(a) does the converse hold? 


12. Prove that if an equilibrium point «* of (1.5.1) is asymptotically stable 
with respect to (1.5.4) (or unstable, as the case may be), it is also so 
with respect to (1.1.1). 


13. Verify formula (1.5.5). 
14. Prove Theorem 1.15, parts (ii) and (iii). 


15. Definition of Semistability. An equilibrium point «* of x(n +1) = 
f(a(n)) is semistable (from the right) if given € > 0 there exists ô > 0 
such that if 7(0) > x*, (0) — «* < ð, then x(n) — x* < £. Semistabil- 
ity from the left is defined similarly. If in addition, lim, ... x(n) = 2* 


1.6 Periodic Points and Cycles 35 


whenever 2(0) — «* < n{x* — x(0) < n}, then z* is said to be semi- 
asymptotically stable from the right {or from the left, whatever the 
case may be}. 

Suppose that if f'(x*) = 1, then f”(x*) #0. Prove that x* is: 


(i) semiasymptotically stable from the right from the right if f”(x*) < 


(ii) semiasymptotically stable from the left from the left if f’(a*) > 0. 


16. Determine whether the equilibrium point x* = 0 is semiasymptotically 
stable from the left or from the right. 


(a) a(nt+1) = 23(n) + 22(n) + x(n). 
(b) a(n+1) = z? (n) — 2?(n) + a(n). 


1.6 Periodic Points and Cycles 


The second most important notion in the study of dynamical systems is the 
notion of periodicity. For example, the motion of a pendulum is periodic. 
We have seen in Example 1.10 that if the sensitivity m, of the suppliers to 
price is equal to the sensitivity of consumers to price, then prices oscillate 
between two values only. 


Definition 1.18. Let b be in the domain of f. Then: 
(i) bis called a periodic point of f (or of (1.5.1)) if for some positive integer 


k, f*(b) = b. Hence a point is k-periodic if it is a fixed point of f*, that 
is, if it is an equilibrium point of the difference equation 


a(n+1) = g(a(n)), (1.6.1) 
where g = f*. 


The periodic orbit of b, O(b) = {b, f(b), f7(b),..., f*-1(b)}, is often 
called a k-cycle. 


(ii) b is called eventually k-periodic if for some positive integer m, f™ (b) is 
a k-periodic point. In other words, b is eventually k-periodic if 


FH O) = f™(0). 


Graphically, a k-periodic point is the x-coordinate of the point where the 
graph of f* meets the diagonal line y = x. Figure 1.25 depicts the graph of 
f?, where f is the logistic map, which shows that there are four fixed points 
of f?, of which two are fixed points of f as shown in Figure 1.26. Hence 
the other two fixed points of f? form a 2-cycle. Notice also that the point 
zo = 0.3 (in Figure 1.26) goes into a 2-cycle, and thus it is an eventually 
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x(n+2) 


x(n) 


FIGURE 1.25. Graph of f? with four fixed points. f(x) = 3.43a(1— x). 


FIGURE 1.26. xo goes into a 2-cycle. f(x) = 3.43x(1 — x). 


2-periodic point. Moreover, the point x* = 0.445 is asymptotically stable 
relative to f? (Figure 1.27). 

Observe also that if A = —1 in (1.3.7), then f?(po) = —(—po + B) + B= 
po. Therefore, every point is 2-periodic (see Figure 1.10). This means that 
in this case, if the initial price per unit of a certain commodity is po, then 
the price oscillates between po and B — po. 


Example 1.19. Consider again the difference equation generated by the 
tent function 


22 for0O<a< 


a 


v= 
8 
ee 
II 
Be NIrR 


1 
2(1 — x) torg Aes 
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X9=0.35 


FIGURE 1.27. x* = 0.445 is asymptotically stable relative to f°. 


This may also be written in the compact form 
1 

r-—-|. 
2 


T(a) =1-2 


We first observe that the periodic points of period 2 are the fixed points of 
T?. It is easy to verify that T? is given by 


4a for0O<a<-, 


1 

2 

T*(x) = 1 1 3 
A(a-—-— forg Ses g 


2 27 
3 
4(1 — x) for 7 S2S1. 


There are four equilibrium points (Figure 1.28): 0, 0.4, 2, and 0.8, two of 
which, 0 and 2, are equilibrium points of T. Hence {0.4, 0.8} is the only 
2-cycle of T. Notice from Figure 1.29 that x* = 0.8 is not stable relative to 
T?. 

Figure 1.30 depicts the graph of T°. It is easy to verify that {2, Z, £} is 
a 3-cycle. Now, 


(i -e 2()-3 


Using a computer or hand-held calculator, one may show (using the stair 
step diagram) that the tent map T has periodic points of all periods. This 
is a phenomenon shared by all equations that possess a 3-cycle. It was 
discovered by Li and Yorke [92] in their celebrated paper “Period Three 
Implies Chaos.” 


38 1. Dynamics of First-Order Difference Equations 


x(n=2) 


x(n+2) 
A 
D 
Le 

l 

Y 

A! 

| 

fg — I 
> x(n) 
x*=0.8 \ 


FIGURE 1.29. x* = 0.8 is unstable relative to T?. 


x(n+3) 


FIGURE 1.30. Fixed points of T?. 
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We now turn our attention to explore the stability of periodic points. 
Definition 1.20. Let b be a k-period point of f. Then b is: 
(i) stable if it is a stable fixed point of f*, 
(ii) asymptotically stable if it is an asymptotically stable fixed point of f*, 
(iii) unstable if it is an unstable fixed point of f*. 


Notice that if b possesses a stability property, then so does every point 
in its k-cycle {2(0) = b, (1) = f(b), 2(2) = f2(b),...,2(k—1) = f¥-h(b)}. 
Hence we often speak of the stability of a k-cycle or a periodic orbit. Figure 
1.29 shows that the 2-cycle in the tent map is not stable, since 7* = 0.8 
is not stable as a fixed point of T?, while the 2-cycle in the logistic map is 
asymptotically stable (see Figure 1.27). 

Since the stability of a k-periodic point 6 of (1.1.1) reduces to the study 
of the stability of the point as an equilibrium point of (1.6.1), one can 
use all the theorems in the previous section applied to f*. For example, 
Theorem 1.13 may be modified as follows. 


Theorem 1.21. Let O(b) = {b = x(0),x(1),...,a(k — 1)} be a k-cycle 
of a continuously differentiable function f. Then the following statements 
hold: 


(i) The k-cycle O(b) is asymptotically stable if 

IF EOF E), F Elk- 1) < 1. 
(ii) The k-cycle O(b) is unstable if 

IF EOF E), f elk- 1))| > 1. 


PROOF. We apply Theorem 1.13 to (1.6.1). Notice that by using the chain 
rule one may show that 


EEE] = FEOF E) -o f (Elk 1). 
(See Exercises 1.6, Problem 12.) 


The conclusion of the theorem now follows. 


Example 1.22. Consider the map Q(x) = x? —0.85 defined on the interval 
[—2, 2]. Find the 2-cycles and determine their stability. 

Solution Observe that Q?(x) = (x? — 0.85)? — 0.85. The 2-periodic points 
are obtained by solving the equation 


Q?(x) = z, or zt — 1.72? — x — 0.1275 = 0. (1.6.2) 


This equation has four roots, two of which are fixed points of the map Q(z). 
These two fixed points are the roots of the equation 


x? — z — 0.85 =0. (1.6.3) 
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To eliminate these fixed points of Q(x) from (1.6.2) we divide the left-hand 
side of (1.6.2) by the left-hand side of (1.6.3) to obtain the second-degree 
equation 


z?+2¢+0.15 =0. (1.6.4) 


The 2-periodic points are now obtained by solving (1.6.4). They are given 
by 


—1 + v0.4 —1 — v0.4 
a = a b = i 
2 2 
To check the stability of the cycle {a,b} we apply Theorem 1.21. Now, 
|Q’(a)Q’ (b)| = |(—1 + V0.4)(-1 — V0.4)| = 0.6 < 1. 


Hence by Theorem 1.21, part (i), the 2-cycle is asymptotically stable. 


Exercises 1.6 


1. Suppose that the difference equation x(n + 1) = f(a(n)) has a 2-cycle 
whose orbit is {a,b}. Prove that: 


(i) the 2-cycle is asymptotically stable if | f'(a) f’(b)| < 1, 
(ii) the 2-cycle is unstable if | f'(a) f’(b)| > 1. 


2. Let T be the tent map in Example 1.17. Show that E $, 8, is an 
unstable 3-cycle for T. 


3. Let f(x) = —$x? — x + $. Show that 1 is an asymptotically stable 


2-periodic point of f. 
In Problems 4 through 6 find the 2-cycle and then determine its stability. 
4. x(n +1) = 3.52(n)[1 — z(n)]. 
5. a(n +1) =1-2?. 
6. a(n +1) = 5-— (6/x(n)). 
ie 


. Let f(x) = ax? — bz +1, where a,b € R. Find the values of a and b for 
which {0,1} is an attracting 2-cycle. 


Consider Baker’s function defined as follows: 


2x for0O<a< 
B(x) = 


= NIe 


1 
2x — 1 fot rs 


Problems 8, 9, and 10 are concerned with Baker’s function B(x) on [0,1]. 


*8. (Hard). Draw Baker’s function B(x). Then find the number of 
n-periodic points of B. 


10. 


11. 


12. 


13. 


14. 
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. Sketch the graph of B? and then find the 2-cycles of Baker’s function 


B. 

(Hard). Show that if m is an odd positive integer, then 7 = k/m is 

periodic, for k = 1,2,...,m — 1. 

Consider the quadratic map 

Q(x) =ar? +br+c, a#0. 

(a) If {d,e} is a 2-cycle such that Q'(d)Q'(e) = —1, prove that it is 
asymptotically stable. 

(b) If {d,e} is a 2-cycle with Q’(d)Q’(e) = 1, what can you say about 
the stability of the cycle? 


(This exercise generalizes the result in Problem 1.) Let {xz(0),x(1),.. 
x(k —1)} bea k-cycle of (1.2.1). Prove that: 


(i) if |f (<0) f’(a@(1)),..., f (x(k — 1))| < 1, then the k-cycle is 
asymptotically stable, 


(ii) if |f (0) f’(@(1)),..., f (x(k — 1))| > 1, then the k-cycle is 
unstable. 


ee 


Give an example of a decreasing function that has a fixed point and a 
2-cycle. 


(i) Can a decreasing map have a k-cycle for k > 1? 


(ii) Can an increasing map have a k-cycle for k > 1? 


Carvalho’s Lemma. In [18] Carvalho gave a method to find periodic 
points of a given function. The method is based on the following lemma. 


Lemma 1.23. If k is a positive integer and x(n) is a periodic sequence 
of period k, then the following hold true: 


(i) Ifk > 1 is odd and m= 55+, then 


for alln > 1. 


(ii) If k is even and k = 2m, then 


m—1 A n 
2 2 
x(n) = co + (—1)” cm + 3 [e cos 72") +d; sin (7) | ; 


foralln>1. 
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Example 1.24 [23]. Consider the equation 
x(n +1) = a(n) exp(r(1 — 2(n)), (1.6.5) 


which describes a population with a propensity to simple exponential 
growth at low densities and a tendency to decrease at high densities. 
The quantity 4 = exp(r(1 — x(n))) could be considered the density- 
dependent reproductive rate of the population. This model is plausible 
for a single-species population that is regulated by an epidemic disease at 
high density. 

The nontrivial fixed point of this equation is given by x* = 1. Now, 
f'(1) = 1 — r. Hence x* = 1 is asymptotically stable if 0 < r < 2 (check 
r = 2). At r = 2,2* = 1 loses its stability and gives rise to an asymptotically 
stable 2-cycle. Carvalho’s lemma implies 


x(n) =a + (—1)”b. 
Plugging this into equation (1.6.5) yields 
a — (—1)”b = (a + (—1)”b) expr(1 — a -— (—1)”b). 
The shift n> n + 1 gives 
a + (—1)”b = (a — (—1)”b) expr(1 — a+ (—1)”b). 
Hence 
a? — b? = (a? — b*) exp2r(1 — a). 


Thus either a? = b?, which gives the trivial solution 0, or a = 1. Hence a 
2-periodic solution has the form a(n) = 1 + (—1)”b. Plugging this again 
into equation (1.6.5) yields 


1 — (—1)"b = (1 + (—1)”b) exp((—1)” trb). 
Let y = (—1)"*1b.Then 


The function g has its minimum at 0, where g(0) = 2. Thus, for r < 
2,g(y) = r has no solution, and we have no periodic points, as predicted 
earlier. However, each r > 2 determines values +y, and the corresponding 
coefficient (—1)"b. Further analysis may show that this map undergoes 
bifurcation similar to that of the logistic map. 


Exercises 1.6 (continued). 


In Problems 15 through 20, use Carvalho’s lemma (Lemma 1.23). 


1.7 The Logistic Equation and Bifurcation 43 


15. Consider Ricker’s equation 
x(n + 1) = a(n) exp(r(1 — a(n))). 
Find the 2-period solution when r > 2. 


16. The population of a certain species is modeled by the difference equa- 
tion x(n + 1) = pa(n)e~*™, a(n) > 0, p > 0. For what values of u 
does the equation have a 2-cycle? 


17. Use Carvalho’s lemma to find the values of c for which the map 
Qez) =z? +c, ce [—2,0), 
has a 3-cycle and then determine its stability. 


18*. (Term Project). Find the values of u where the logistic equation z(n + 
1) = px(n)[1 — x(n)] has a 3-periodic solution. 


19. Use Carvalho’s lemma to find the values of js where the logistic 
equation x(n + 1) = uz(n)[1 — x(n)] has a 2-periodic solution. 


20. Find the 3-periodic solutions of the equation a(n +1) =aa(n), a #1. 


1.7 The Logistic Equation and Bifurcation 


Let us now return to the most important example in this chapter: the 
logistic difference equation 


x(n +1) = pa(n)[1 — x(n)], (1.7.1) 
which arises from iterating the function 
F,,(x) = px(1 — x), x € [0,1], u>o0. (1.7.2) 


1.7.1 Equilibrium Points 


To find the equilibrium points (fixed points of F„) of (1.7.1) we solve the 
equation 


F,,(2*) = a*. 


Hence the fixed points are 0,2* = (u — 1)/u. Next we investigate the 
stability of each equilibrium point separately. 


(a) The equilibrium point 0. (See Figures 1.31, 1.32.) Since F; (0) = p, it 
follows from Theorems 1.13 and 1.15 that: 


(i) 0 is an asymptotically stable fixed point for 0 < u < 1, 


(ii) 0 is an unstable fixed point for u > 1. 
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x(n+1) 


x(n) 
Xo 


FIGURE 1.31. 0 < u < 1 : 0 is an asymptotically stable fixed point. 


FIGURE 1.32. u > 1 : 0 is an unstable fixed point, x* is an asymptotically fixed 
point. 


The case where u = 1 needs special attention, for we have F{(0) = 1 
and F” (0) = —2 4 0. By applying Theorem 1.15 we may conclude that 
0 is unstable. This is certainly true if we consider negative as well as 
positive initial points in the neighborhood of 0. Since negative initial 
points are not in the domain of F, we may discard them and consider 
only positive initial points. Exercises 1.5, Problem 16 tells us that 0 is 
semiasymptotically stable from the right, i.e., c* = 0 is asymptotically 
stable in the domain [0, 1]. 


(b) The equilibrium point «* = (u — 1)/u, u 4 1. (See Figures 1.32, 1.33.) 


In order to have x* € (0, 1] we require that u > 1. Now, F; ((u—1)/u) = 2— 
H. Thus using Theorems 1.13 and 1.16 we obtain the following conclusions: 
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(n+1) 


x 
A 


FIGURE 1.33. u > 3: 2* is an unstable fixed point. 


(i) «* is an asymptotically stable fixed point for 1 < u < 3 (Figure 1.32). 
(ii) 2* is an unstable fixed point for u > 3 (Figure 1.33). 


1.7.2 2-Cycles 


To find the 2-cycles we solve the equation F7(%) = x (or we solve z2 = 
px (1 = £1), 21 = pxo(1 = 2)), 
p(l —2)[1 — pe(1 — x)|] — x = 0. (1.7.3) 


Discarding the equilibrium points 0 and 7* = #1 one may then divide 
1.7.3) by the factor x(a — (u — 1 to obtain the quadratic equation 
y H H 
ur? — pulu+1i)e+u+1l =o. 


Solving this equation produces the 2-cycle 
2(0) = [0 + p) - V@=3)H 40] /2p, 
a(1) = [0+ a) + V= 3E FD] /2 (1.7.4) 


Clearly, there are no periodic points of period 2 for 0 < u < 3, and there 
is a 2-cycle for u > 3. For our reference we let uo = 3. 


1.7.2.1 Stability of the 2-Cycle {x(0), x(1)} for u > 3 
From Theorem 1.21, this 2-cycle is asymptotically stable if 
|F} ((0)) Fi (@(1))| < 1, 
or 
—1 < x? (1 — 22(0))(1 — 2z(1)) < 1. (1.7.5) 
Substituting from (1.7.4) the values of z(0) and z(1) into (1.7.5), we obtain 
3 < u < 1+ v6 ~ 3.44949. 
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Conclusion This 2-cycle is attracting if 3 < u < 3.44949.... 


Question What happens when u = 1 + v6? 
In this case, 


[F?(«(0))]’ = F; (æ(0)) Fi (e(1)) = —1. (1.7.6) 


(Verify in Exercises 1.7, Problem 7.) 

Hence we may use Theorem 1.16, part (i), to conclude that the 2-cycle is 
also attracting. For later reference, let yı = 1 + V6. Moreover, the 2-cycle 
becomes unstable when u > pı = 1 + V6. 


1.7.3 2?-Cycles 


To find the 4-cycles we solve F a(z) = x. The computation now becomes 
unbearable, and one should resort to a computer to do the work. It turns 
out that there is a 2?-cycle when u > 1+ v6, which is attracting for 
14+ V6 < u < 3.544090.... This 2?-cycle becomes unstable at u > u2 = 
3.544090... 

When p = u2, the 2?-cycle bifurcates into a 2° cycle. The new 2° cycle 
is attracting for u3 < u < u4 for some number py. This process of double 
bifurcation continues indefinitely. Thus we have a sequence {ti}? 9 where 
at un there is a bifurcation from a 2"~1-cycle to a 2”-cycle. (See Figures 
1.34, 1.35.) Table 1.4 provides some astonishing patterns. 

From Table 1.4 we bring forward the following observations: 


(i) The sequence {un} seems to converge to a number Hoo = 3.57.... 


(ii) The quotient (Hn — Hn—1)/(Hn+1 — Hn) seems to tend to a number ô = 
4.6692016.... This number is called the Feigenbaum number after its 
discoverer, the physicist Mitchell Feigenbaum [56]. In fact, Feigenbaum 
made a much more remarkable discovery: The number 6 is universal 
and is independent of the form of the family of maps f,,. However, the 
number Hoo depends on the family of functions under consideration. 


1 3 Ne 


FIGURE 1.34. Partial bifurcation diagram for {F}. 
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FIGURE 1.35. The bifurcation diagram of F',. 


TABLE 1.4. Feigenbaum table. 


n Hn Hn — Hn-~1 Pn in 
Hn+1 — Hn 

0 3 = = 

1 3.449499... 0.449499... Z 

2 3.544090... 0.094591 ... 4.752027 ... 

3 3.564407... 0.020313 ... 4.656673 ... 

4 3.568759... 0.004352 ... 4.667509 ... 

5 3.569692... 0.00093219... 4.668576 ... 

6 3.569891... 0.00019964... 4.669354... 


Theorem 1.25 (Feigenbaum [56] (1978)). 
ilies of maps (such as F,,) of an interval into itself, the number 6 = 
4.6692016 does not in general depend on the family of maps. 


1.74 The Bifurcation Diagram 


Here the horizontal axis represents the u values, and the vertical axis repre- 
sents higher iterates F(x). For a fixed xo, the diagram shows the eventual 
behavior of F? (xo). The bifurcation diagram was obtained with the aid of 


For sufficiently smooth fam- 
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=a 


zog for H € [0,4] and plotting 


a computer for zo = 4, taking increments of 
all points (u, Fy (5)) for 200 < n < 500. 


Question What happens when u > boo? 

Answer From Figure 1.35 we see that for Uo < u < 4 we have a large 
number of small windows where the attracting set is an asymptotically sta- 
ble cycle. The largest window appears at approximately u = 3.828427..., 
where we have an attracting 3-cycle. Indeed, there are attracting k-cycles 
for all positive integers k, but their windows are so small that they may 
not be noticed without sufficient zooming. As in the situation where 
H < oo, these k-cycles lose stability and then double bifurcate into at- 
tracting 2”k-cycles. We observe that outside these windows the picture 
looks chaotic! 


Remarks: Our analysis of the logistic map F, may be repeated for any 
quadratic map Q(x) = ax? + bx + c. Indeed, the iteration of the quadratic 
map Q (with suitably chosen parameters) is equivalent to the iteration of 
the logistic map F),. In other words, the maps Q and F, possess the same 
type of qualitative behavior. The reader is asked, in Exercises 1.7, Problem 
11, to verify that one can transform the difference equation 


y(n +1) = y(n) +e (1.7.7) 
to 
x(n +1) = pa(n)[l — z(n)] (1.7.8) 
by letting 
H p p 
y(n) = —uz(n) + z’ Ce ae (1.7.9) 


Note here that u = 2 corresponds to c = 0, u = 3 corresponds to c = =, 


and u = 4 corresponds to c = —2. Naturally, we expect to have the same 
behavior of the iteration of (1.7.7) and (1.7.8) at these corresponding values 
of u and c. 


Comments: We are still plagued by numerous unanswered questions in 
connection with periodic orbits (cycles) of the difference equation 


x(n +1) = f(a(n)). (1.7.10) 


Question A. Do all points converge to some asymptotically stable periodic 
orbit of (1.7.8)? 
The answer is definitely no. 

If f(x) = 1 — 2x? in (1.7.10), then there are no asymptotically stable 
(attractor) periodic orbits. Can you verify this statement? If you have some 
difficulty here, it is not your fault. Obviously, we need some tools to help 
us in verifying that there are no periodic attractors. 
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Question B. If there is a periodic attractor of (1.7.10), how many points 
converge to it? 
Once again, we need more machinery to answer this question. 


Question C. Can there be several distinct periodic attractors for (1.7.10)? 


This question leads us to the Li-Yorke famous result “Period Three Implies 
Chaos” [92]. To explain this and more general results requires the intro- 
duction of the so-called Schwarzian derivative of f(x). We will come back 
to these questions in Chapter 6. 


Exercises 1.7 


Unless otherwise stated, all the problems here refer to the logistic difference 
equation (1.7.1). 


1. Use the stair step diagram for FF on [0,1], k = 1, 2, 3, ..., to demon- 
strate that Fy has at least 2* periodic points of period k (including 
periodic points of periods that are divisors of k). 


2. Find the exact solution of x(n + 1) = 4a(n)[1 — x(n)]. 

3. Let x* = (u — 1)/p be the equilibrium point of (1.7.1). Show that: 
(i) For 1 < u < 3, x* is an attracting fixed point. 
(ii) For u > 3, 2* is a repelling fixed point. 

4. Prove that limnoo. Ff (xz) = 5 if0<a<1. 

5. Let 1 < u < 2 and let x* = (u — 1)/u be the equilibrium point of 
(1.7.1). Show that if «* < x < 5, then limp yoo F"(x) = 2*. 


6. Prove that the 2-cycle given by (1.7.4) is attracting if 3 < u < 1 + v6. 


7. Verify formula (1.7.6). Then show that the 2-cycle in (1.7.4) is 
attracting when u = 1 + V6. 


8. Verify that u2 + 3.54 using a calculator or a computer. 


*9. (Project). Show that the map H,,(x) = sin yx leads to the same value 
for the Feigenbaum number 6. 


10. Show that if |u — u| < £, then |Fyu(x) — Fy (x)| < € for all x € [0,1]. 


11. Show that (1.7.7) can be transformed to the logistic equation (1.7.8), 
be e 


12. (a) Find the equilibrium points y% , y3 of (1.7.7). 
(b) Find the values of c where yi is attracting or unstable. 


(c) Find the values of c where Yo is attracting or unstable. 
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13. Find the value of co where (1.7.7) double bifurcates for c > co. Check 
your answer using (1.7.9). 


*14. (Project). Use a calculator or a computer to develop a bifurcation 
diagram, as in Figures 1.34, 1.35, for (1.7.6). 


*15. (Project). Develop a bifurcation diagram for the quadratic map 
Q(x) = 1 — Az? on the interval [—1,1], A € (0, 2]. 


In Problems 16-19 determine the stability of the fixed points of the 
difference equation. 


16. x(n + 1) = x(n) + 4 sin(2rz(n)). 
17. x(n + 1) = 0.5sin(rz(n)). 
18. x(n + 1) = 2z(n) exp(—z(n)). 


19. A population of birds is modeled by the difference equation 
3.2x(n) for 0< a(n) <1, 
a(n+1)= 
0.5a(n) for x(n) > 1, 


where x(n) is the number of birds in year n. Find the equilibrium points 
and then determine their stability. 


1.8 Basin of Attraction and Global Stability 
(Optional) 


It is customary to call an asymptotically stable fixed point or a cycle an 
attractor. This name makes sense since in this case all nearby points tend 
to the attractor. The maximal set that is attracted to an attractor M is 
called the basin of attraction of M. Our analysis applies to cycles of any 
period. 


Definition 1.26. Let x* be a fixed point of map f. Then the basin of 
attraction (or the stable set) W*(a*) of x* is defined as 


W*(a*) ={a: lim f"(x) = 2*}. 
noo 
In other words, W*(a*) consists of all points that are forward asymptotic 
to x. 


Observe that if «* is an attracting fixed point, W*(x*) contains an open 
interval around x*. The maximal interval in W*(a*) that contains «* is 
called the immediate basin of attraction and is denoted by B°(x*). 


Example 1.27. The map f(x) = x? has one attracting fixed point x* = 0. 
Its basin of attraction W*(0) = (—1,1). Note that 1 is an unstable fixed 
point and —1 is an eventually fixed point that goes to 1 after one iteration. 
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FIGURE 1.36. The basin of attraction W°(0) = (—1,1) and W°*(4) = [-2, —1) U 
(1, 4]. The immediate basin of attraction B(4) = (1, 4]. 


Example 1.28. Let us now modify the map f. Consider the map g : 
[—2,4] — [—2, 4] defined as 


x if—2<x<1, 
g(x) = , 
3vVz—-2 ifl<zx<4. 


The map g has three fixed points 7} = 0, x3 1, x3 = 4. The basin 
of attraction of z} = 0, W*(0) = (—1,1), while the basin of attraction 
of #3 = 4, W*(4) = [—2,-1) U (1,4]. Moreover, the immediate basin of 
attractions of x] = 0 is B(0) = W*(0) = (—1, 1), while B(4) = (1,4). 


Remark: Observe that in the preceding example, the basins of attraction 

of the two fixed points x} = 0 and x3 = 4 are disjoint. This is no accident 

and is, in fact, generally true. This is due to the uniqueness of a limit of 

a sequence. In other words, if the lim f"(#) = Lı and lim f”(x) = Lə, 
n— o0 n—> o0 


then certainly Lı = Lə. 


It is worth noting here that finding the basin of attraction of a fixed point 
is in general a difficult task. But even more difficult is providing a rigorous 
proof. The most efficient method to determining the basin of attraction 
is the method of Liapunov functions, which will be developed in Chapter 
4. In this section, we will develop some of the basic topological properties 
of the basin of attractions. Henceforth, all our maps are assumed to be 
continuous. We begin our exposition by defining the important notion of 
invariance. 


Definition 1.29. A set M is positively invariant under a map f if 
f(M) C M. In other words, for every x € M, O(x) C M. Since we are only 
considering forward iterations of f, the prefix “positively” will henceforth 
be dropped. 
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Clearly an orbit of a point is invariant. 
Next we show that the basin of attraction of an attracting fixed point is 
invariant and open. 


Theorem 1.30. Let f : I > I, I = [a,b], be a continuous map and let 
x* € [a,b] be a fixed point of f. Then the following statements hold true: 


(i) The immediate basin of attraction B(x*) is an interval containing 


x*, which is either an open interval (c,d) or of the form [a,c)(c, b]. 
Moreover, B(x*) is invariant. 


(ii) W*(a*) is invariant. Furthermore, W*(x*) is the union (maybe an 
infinite union) of intervals that are either open intervals or of the form 
[a,c) or (d, b]. 


PROOF. 


(i) We know that B(x*) is a maximal interval in W*(x*) containing «*. 
Assume that B(x*) = [c, d), c # a. Now for a given small € > 0 there 
exists m € Z* such that f™(c) € (x* —e,a2* +£) C (c,d). Since 
f™ is continuous, there exists 6 > 0 such that if a € (c — ð,c + 
ô), then f™(ao) E€ (a* — €,2* +e) C B(a*). Then zo € B(x*) and 
hence (c — 6,d) C W*(a*) which violates the maximality of B(2*). 
Hence B(a*) 4 [c, a), a contradiction. Analogously, one may show that 
W*(a*) Z (c d] if d £ b. 


To prove the invariance of B(x*), assume that there exists y € B(x") 
such that f"(y)  B(x*) for some r € Z*. Since B(x*) is an interval, 
it follows by the Intermediate Value Theorem that f”(B(x*)) is also 
an interval. Moreover, this interval f”(B(x*)) must contain «* since 
f'(a*) = x*. Thus f” (B(<*))OB(x*) #0, and hence B(a2*)U f” (B(a*)) 
is an interval in W*(a*), which violates the maximality of B(x"). 


(ii 


wa 


The proof of this part is analogous to the proof of part (a) and will be 
left to the reader to verify. 


There are several (popular) maps such as the logistic map and Ricker’s 
map in which the basin of attraction, for the attractive fixed point, is the 
entire space with the exception of one or two points (fixed or eventually 
fixed). For the logistic map F,,(x) = uz(1 — x) and 1 < u < 3, the basin of 
attraction W*(a«*) = (0,1) for the fixed point x* = ree And for Ricker’s 
map R,(x) = xe?-*, 0 < p < 2, the basin of attraction W*(«*) = (0,00), 
for «* = p. Here we will consider only the logistic map and leave it to the 
reader to prove the statement concerning Ricker’s map. 

Notice that |F"(x)| = |u—2ya| < 1 if and only if —1 < p—2ya < 1. This 


implies that Tn <au< oma Hence |F/,(x)| < 1 for all x € (z. stt), 


Observe that 2* = e= (4. nit) if and only if 1 < u < 3. Now 
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F, (44) = = F, (st oa +) = 5 [e=], Notice that since 1 < u < 3, 


pol 1 , (#—1)(u+1) — wt bol pti 8 (a* 
Ts on < >. Hence i Da c W(2*). 


fz € a ut), then Fi(z) > 1. By the Mean Value Theorem, 
= F; (7), for some y with 0 < y < z. Hence 

F(z) — Fu(0) = Fulz) 2 pz 
for some 8 > 1. Then for some r € Zt, F(z) > B"z > E and F(z) < 
orm Moreover, since F is increasing on |o, £ m el, F; (z ) < F, (43) = 


u (e) (1 i) = = (£41) < x*. Thus z € W*(a*). On the other 


2u 2u H 
hand, F, (451) C (0,2*) and hence (44.1) C W*(a*). This shows 


that W*(a*) = (0,1). 
To summarize 


Lemma 1.31. For the logistic map F,(x) = pa(l— x), 1 < u < 3, 
W*(a*) = (0,1) for x* = oe 


We now turn our attention to periodic points. If z is a periodic point 
of period k under the map f, then its basin of attraction W*(Z) is its 
basin of attraction as a fixed point under the map f*. Hence W*(z) = 
{x: Jim (f*)" (2) = Jim, f=” (x) = z}. Let {71, T2,..., Zp} be a k-cycle 
of a map f. Then clearly for i Æ j, W° (z1) NM W*(Z;) = 0. (Why?) More 
generally, if x is a periodic point of period r and y Æ x is a periodic point 
of period s, then W° (x) N W*(y) = @ (Exercises 1.8, Problem 6). 


Example 1.32. Consider the function f(x) = —x3. Then «* = 0 is the 
only fixed point. There is a 2-cycle {—1,1} with f(—1) = 1, f?(-—1) = -1. 
The cobweb diagram (Figure 1.37) shows that W*(1) = (0,00), W*(—1) = 
(—00, 0). 


FIGURE 1.37. 
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Exercises 1.8 
1. Investigate the basin of attraction of the fixed points of the map 
r? if—-3<xr<1, 
f(x) = ; 
4A/x—-3 ifl<a2<9. 
2. Let f(x) = |x — 1|. Find W°(5). 


3. Suppose that f : J > I is a continuous and onto map on an interval J. 
Let z be an asymptotically stable periodic point of period k > 2. Show 
that W*(f(z)) = f(W*(2)). 


4. Describe the basin of attraction of all fixed and periodic points of the 


maps: 
(i) f(x) ==", 
(ii) g(a) = 2°, 
(iii) h(a) = 2xe77, 
(iv) g(x) = -4 arctan z. 


5. Investigate the basin of attraction of the origin for the map 
x 


3 if 0 < x< 0.2, 
=3 1 if 0.2 < Zt 
f(x) = x 5 if 0. TS 


1 
2 — 2x fz <2. 


6. Let f be a continuous map that has two periodic points x and y, x Æ y, 
with periods r and t, r Æ t, respectively. Prove that W*(x)NW*(y) = 0. 


7*. Suppose that a set M is invariant under a one-to-one continuous map 
f. A point x € M is said to be an interior point if (x — ô, x + ô) C M 
for some ô > 0. Prove that the set of all interior points of M, denoted 
by int(M), is invariant. 


8. Let x* be an attracting fixed point under a continuous map f. If the 
immediate basin of attraction B(x*) = (a,b), show that the set {a,b} 
is invariant. Then conclude that there are only three scenarios in this 
case: (1) both a and b are fixed points, or (2) a or b is fixed and the 
other is an eventually fixed point, or (3) {a,b} is a 2-cycle. 


9. Show that for Ricker’s map 
R,(z) =aeP*, O0<p<2, 
W*(a*) = (0,00), where x* = p. 


10. (Term Project). Consider the logistic map F(x) = pa(1 — x) with 
3<p<14+V6. Let c= {%1, Z2} be the attracting 2-cycle. Show that 
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W*(c) = W*(%1) U W* (#2) is all the points in (0,1) except the set of 
eventually fixed points (including the fixed point ue). 


2 


Linear Difference Equations 
of Higher Order 


In this chapter we examine linear difference equations of high order, namely, 
those involving a single dependent variable.! Such equations arise in almost 
every field of scientific inquiry, from population dynamics (the study of a 
single species) to economics (the study of a single commodity) to physics 
(the study of the motion of a single body). We will become acquainted 
with some of these applications in this chapter. We start this chapter by 
introducing some rudiments of difference calculus that are essential in the 
study of linear equations. 


2.1 Difference Calculus 


Difference calculus is the discrete analogue of the familiar differential and 
integral calculus. In this section we introduce some very basic properties of 
two operators that are essential in the study of difference equations. These 
are the difference operator (Section 1.2) 


Aa(n) = a(n + 1) — a(n) 
and the shift operator 
Ex(n) = z(n+ 1). 


Difference equations that involve more than one dependent variable are called 
systems of difference equations; we will inspect these equations in Chapter 3. 


57 
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It is easy to see that 
E¥ x(n) = z(n + k). 


However, A*a(n) is not so apparent. Let I be the identity operator, i.e., 
Ix = x. Then, one may write A= E — I and E= A +I. 
Hence, 


k 
AŽte(n) = Don (Hen+ ko, (2.1.1) 


Similarly, one may show that 


k 


E¥z(n) = X` (‘) AF-*g(n). (2.1.2) 


i=0 


We should point out here that the operator A is the counterpart of the 
derivative operator D in calculus. Both operators Æ and A share one of 
the helpful features of the derivative operator D, namely, the property of 
linearity. 

“Linearity” simply means that A[ax(n) + by(n)] = aAz(n)+bAy(n) and 
Elax(n) + by(n)]| = aEa(n) + bEy(n), for all a and b € R. In Exercises 
2.1, Problem 1, the reader is allowed to show that both A and E are linear 
operators. 

Another interesting difference, parallel to differential calculus, is the 
discrete analogue of the fundamental theorem of calculus. ? 


Lemma 2.1. The following statements hold: 


(i) 


XC Aa(k) = x(n) — 2(no), (2.1.3) 


?The fundamental theorem of calculus states that: 
(i) Sy df(x) = f(b) — f(a), 
(ii) d (JP FŒ) dt) = f(a). 
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(ii) 


A (S w) = a(n). (2.1.4) 


k=no 


ProoF. The proof remains as Exercises 2.1, Problem 3. 


We would now like to introduce a third property that the operator A 
has in common with the derivative operator D. 
Let 


p(n) = aon" + ayn*-1 +--+ + ak 
be a polynomial of degree k. Then 


Ap(n) [ao(n + 1)* + a(n +1)! +--+ + a] 


= [agn* + ajn"! ++ ap] 


II 


=aokn*—! + terms of degree lower than (k — 1). 
Similarly, one may show that 
A? p(n) = agk(k — 1)n*~* + terms of degree lower than (k — 2). 
Carrying out this process k times, one obtains 
A* p(n) = aok!. (2.1.5) 
Thus, 
A***p(n) = 0 for i> 1. (2.1.6) 


2.1.1 The Power Shift 


We now discuss the action of a polynomial of degree k in the shift operator 
E on the term b”, for any constant b. 
Let 


p(E) = ag E* + a, EP 1 +--+ ag! (2.1.7) 


be a polynomial of degree k in E. 
Then 


p(E)b” = agb? tA E ajb” tkt fee + agb” 
= (aob + a,b*-1 +--+ ap)b” 
= p(b)b”. (2.1.8) 


A generalization of formula (2.1.8) now follows. 
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Lemma 2.2. Let p(E) be the polynomial in (2.1.7) and let g(n) be any 
discrete function. Then 


p(E)(b"g(n)) = b"p(bE)g(n). (2.1.9) 


ProoF. This is left to the reader as Exercises 2.1, Problem 4. 


2.1.2 Factorial Polynomials 


One of the most interesting functions in difference calculus is the factorial 
polynomial «) defined as follows. Let x € R. Then the kth factorial of x 
is given by 

a*) = ¢(a—1)---(e—k+1), keZt. 


Thus if x = n € Z* and n> k, then 


! 
(ene 
TB! 


and 
n™ =n. 


The function x“) plays the same role here as that played by the poly- 
nomial x” in differential calculus. The following Lemma 2.3 demonstrates 
this fact. 

So far, we have defined the operators A and E on sequences f(n). One 
may extend the definitions of A and E to continuous functions f(t), t € R, 
by simply letting Af(t) = f(t +1) — f(t) and Ef(t) = f(t + 1). This 
extension enables us to define A f(x) and Ef(x) where f(x) = a) by 


Ac = (¢+1)—2) and Ex® = (2+1)™. 
Using this definition one may establish the following result. 


Lemma 2.3. For fixed k € Z* and x € R, the following statements hold: 


Ag) = ket). (2.1.10) 


Arc) = k(k-1),...,(k—-n+1)24-; (2.1.11) 


AFg() = kl. (2.1.12) 
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Ag) = (a+ 1)) — x) 
= (24 Vale —1) +(e — +2) —2(@-1) 
“(vc —k+2)(a—k+1) 
=a(a—1)---(w—-k+2)-k 
= keh), 


The proofs of parts (ii) and (iii) are left to the reader as Exercises 2.1, 
Problem 5. 


If we define, for k € Zt, 


1 


ah) = 
s(x +1)---(x+k-—1) 


(2.1.13) 


and 2°) = 1, then one may extend Lemma 2.3 to hold for all k € Z. In other 
words, parts (i), (ii), and (iii) of Lemma 2.3 hold for all k € Z (Exercises 
2.1, Problem 6). 

The reader may wonder whether the product and quotient rules of the 
differential calculus have discrete counterparts. The answer is affirmative, 
as may be shown by the following two formulas, where proofs are left to 
the reader as Exercises 2.1, Problem 7. 

Product Rule: 


Alz(n)y(n)] = Ex(n)Ay(n) + y(n)Az(n). (2.1.14) 
Quotient Rule: 
z(n)| _ y(n)Ax(n) — x(n)Ay(n) 
Eo eee. ne 


2.1.8 The Antidifference Operator 


The discrete analogue of the indefinite integral in calculus is the antidif- 
ference operator A~', defined as follows. If AF(n) = 0, then A~!(0) = 
F(n) = c for some arbitrary constant c. Moreover, if AF (n) = f(n), then 
AT! f(n) = F(n) + c, for some arbitrary constant c. Hence 


AA~' f(n) = f(n), 
A~'AF(n) = F(n) +c, 


and 


KAS =] but Asta 
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Using formula (2.1.4) one may readily obtain 


A“! f(n) = > fi) +c. (2.1.16) 


Formula (2.1.16) is very useful in proving that the operator A7! is linear. 
Theorem 2.4. The operator AT! is linear. 


PROOF. We need to show that for a,b € R, A~}[ax(n) + by(n)] = 
aA~'a(n) + bA~ty(n). Now, from formula (2.1.16) we have 


A [aa(n) + by(n)] = 3 ax(i) + byli) 
= oS al) +0 ul) 
=0 i=0 

= TE te(n) + bDA~ty(n). 


Next we derive the antidifference of some basic functions. 


Lemma 2.5. The following statements hold: 


(i) 
ATEO = can”! + con"? +--+ ck (2.1.17) 
(ii) 
nk 
A*I = TI antl + eont? ree Ch (2.1.18) 
(iii) 
(k+1) 
Aine =” kti; 2.1.19 
Ore # (2.1.19) 


PROOF. The proofs of parts (i) and (ii) follow by applying A’ to the 
right-hand side of formulas (2.1.17) and (2.1.18) and then applying formulas 
(2.1.6) and (2.1.5), respectively. The proof of part (iii) follows from formula 
(2.1.10). 

Finally, we give the discrete analogue of the integration by parts formula, 
namely, the summation by parts formula: 


E uk) Ae(k) = 2 joe (k + 1)Ay(k) + (2.1.20) 
k=0 


> 


To prove formula (2.1.20) we use formula (2.1.14) to obtain 
y(n)Aa(n) = A(a(n)y(n)) — x(n + 1)Ay(n). 
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Applying AT! to both sides and using formula (2.1.16), we get 


n-1 n—-1 


y(k)Aa(k) = 2(n)y(n) — X` a(k + 1)Ay(k) +c 


k=0 k=0 


Exercises 2.1 


1. 


10. 


11. 


12. 


13. 


14. 


oN o napev 


Show that the operators A and E are linear. 


. Show that E* a(n) = D (‘) A*-tz(n). 


i=0 


. Verify formulas (2.1.3) and (2.1.4). 
. Verify formula (2.1.9). 
. Verify formulas (2.1.11) and (2.1.12). 


Show that Lemma 2.3 holds for k € Z. 


. Verify the product and quotient rules (2.1.14) and (2.1.15). 


. (Abel’s Summation Formula). Prove that 


n n n k 
X a(k)y(k) = a(n +1) X` y(k -X (ane (k) Soy o). 


k=1 k=1 k=1 


. (Newton’s Theorem). If f(n) is a polynomial of degree k, show that 


n@) nB nE) 
f(r) = FO) + FAFO + ra dr A FO). 


(The Discrete Taylor Formula). Verify that 


rin = 5 (Haso wS ("i a Jat) 


(The Stirling Numbers). The Stirling numbers of the second kind s;(k) 
are defined by the difference equation s;(m + 1) = s;_1(m) + is;(m) 
with s;(i) = sı(i)= 1 and 1 < i < m, sı(k) = 0 for 1 > k. Prove that 


LS X 5i(m)a™. (2.1.21) 


i=1 
Use (2.1.21) to verify Table 2.1 which gives the Stirling numbers s;(k) 
for 1 <i,k <7. 

Use Table 2.1 and formula (2.1.21) to write z3, xt, and z? in terms of 
the factorial polynomials a) (e.g., x? = 2 + z). 


Use Problem 13 to find 
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TABLE 2.1. Stirling numbers s;(k). 


ik 12345 6 7 


1 Led, Se a i 1 1 

2 1 3 7 #15 31 63 
3 1 6 2 90 301 
4 1 10 65 350 
5 1 15 140 
6 1 21 
6 1 


(i) A-1(n3 +1). 


ve — 3) ) 
15. Use Problem 13 to solve the difference equation y(n + 1) = y(n) + n°. 
16. Use Problem 13 to solve the difference equation y(n+1) = y(n) —5n?. 
17. Consider the difference equation? 
y(n + 1) = a(n)y(n) + g(n). (2.1.22) 
(a) Put y(n) = (aai) u(n) in (2.1.22). Then show that 
Au(n) = g(n)/ Tiz aÒ. 
(b) Prove that 
n—1 n—1 / n-1 
y(n) = (To) wt» ( II 0) g(r), yo = y(0). 
i=0 r=0 \i=r+1 


(Compare with Section 1.2.) 


2.2 General Theory of Linear Difference Equations 


The normal form of a kth-order nonhomogeneous linear difference equation 
is given by 


y(n + k) + pi(n) y(n + k = 1) ++: + p(n) y(n) = g(n), (2.2.1) 


where p;(n) and g(n) are real-valued functions defined for n > no and 
pr(n) #0 for all n > no. If g(n) is identically zero, then (2.2.1) is said to 
be a homogeneous equation. Equation (2.2.1) may be written in the form 


y(n +k) = -pı (n) y(n +k — 1) — --- — px(n) y(n) +g(n). (2.2.2) 


3This method of solving a nonhomogeneous equation is called the method of 
variation of constants. 
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By letting n = 0 in (2.2.2), we obtain y(k) in terms of y(k — 1), y(k — 
2),--- ,y(0). Explicitly, we have 
y(k) = —pi(O)y(& — 1) — p2(0)y(k — 2) — - - - — pe(0)y(0) + g(0). 


Once y(k) is computed, we can go to the next step and evaluate y(k + 1) 
by letting n = 1 in (2.2.2). This yields 


ylk + 1) = —pi(l)y(k) — pa(1)y(k = 1) — +++ = pr(1)y(1) + g(1). 


By repeating the above process, it is possible to evaluate all y(n) for n > k. 
Let us now illustrate the above procedure by an example. 


Example 2.6. Consider the third-order difference equation 
y(n +3) —- un +2) + ny(n+ 1) — 3y(n) =n, (2.2.3) 


where y(1) = 0,y(2) = —1, and y(3) = 1. Find the values of y(4), y(5), 
y(6), and y(7). 


Solution First we rewrite (2.2.3) in the convenient form 


y(n + 3) = 4 pyr +2) —ny(n+1) 4+ 3y(n) +n. (2.2.4) 
Letting n = 1 in (2.2.4), we have 
1 5 
y(4) = Sy(3) — y(2) + 8y(1) +1 = 5. 
For n = 2, 
2 
y(5) = 3y(4) — 2y(3) + 3y(2) +2 = -3 
For n = 3, 
3 
y(6) = Fy(5) — 3y(4) + 3y(3) +3 = —5. 
For n = 4, 


y(7) = =u(6) Ay(5) + 3y(4) +4 = 20.9. 


Now let us go back to (2.2.1) and formally define its solution. A sequence 
{y(n) ja or simply y(n) is said to be a solution of (2.2.1) if it satisfies the 
equation. Observe that if we specify the initial data of the equation, we are 
led to the corresponding initial value problem 


y(k +n) + pi(n)y(n +k- 1) +: -+ pe(n)y(n) = g(n), (2.2.5) 
y(no) = ao, y(no+ 1) = a4,...,y9(no + k — 1) = ak-1, (2.2.6) 


where the a,’s are real numbers. In view of the above discussion, we 
conclude with the following result. 
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Theorem 2.7. The initial value problems (2.2.5) and (2.2.6) have a 
unique solution y(n). 


ProoFr. The proof follows by using (2.2.5) for n = no, no + 1, no +2,.... 
Notice that any n > no + k may be written in the form n = no + k + 
(n — no — k). By uniqueness of the solution y(n) we mean that if there is 
another solution ¥(n) of the initial value problems (2.2.5) and (2.2.6), then 
y(n) must be identical to y(n). This is again easy to see from (2.2.5). 


The question still remains whether we can find a closed-form solution 
for (2.2.1) or (2.2.5) and (2.2.6). Unlike our amiable first-order equations, 
obtaining a closed-form solution of (2.2.1) is a formidable task. However, if 
the coefficients p; in (2.2.1) are constants, then a solution of the equation 
may be easily obtained, as we see in the next section. 

In this section we are going to develop the general theory of kth-order 
linear homogeneous difference equations of the form 


a(n+k)+pi(n)a(n+k—1)+---+p,(n)x(n) = 0. (2.2.7) 
We start our exposition by introducing three important definitions. 


Definition 2.8. The functions fi(n), fo(n),...,f-(m) are said to be lin- 
early dependent for n > no if there are constants a1,a2,...,@,, not all zero, 
such that 


arfi(n) + agfo(n) +---+a,f,(n) = 0, n> no. 
If a; £0, then we may divide (2.2.7) by a; to obtain 


fi(n) = hi) 5 a hln) p atl) 
=-5> “ fi(n). (2.2.8) 


ižj I 

Equation (2.2.8) simply says that each f; with nonzero coefficient is a 
linear combination of the other f;’s. Thus two functions fi(n) and fo(n) 
are linearly dependent if one is a multiple of the other, i.e., fi(n) = afa(n), 
for some constant a. 

The negation of linear dependence is linear independence. Explicitly put, 
the functions fi(n), fo(n),..., fr(n) are said to be linearly independent for 
n > no if whenever 


aifi(n) + a2fo(n) +--+ +a, fr(n) = 0 


for all n > no, then we must have a, = a2 =--- =a, = 0. 


Let us illustrate this new concept by an example. 


Example 2.9. Show that the functions 3”, n3”, and n?3” are linearly 
independent on n > 1. 
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Solution Suppose that for constants a1, a2, and a3 we have 
a13” + agn3” + agn73" = 0, for all n > 1. 
Then by dividing by 3” we get 
a, + aon + azn? = 0, for all n > 1. 
This is impossible unless a3 = 0, since a second-degree equation in n pos- 
sesses at most two solutions n > 1. Hence a, = ag = a3 = 0. Similarly, 


a2 = 0, whence a, = 0, which establishes the linear independence of our 
functions. 


Definition 2.10. A set of k linearly independent solutions of (2.2.7) is 
called a fundamental set of solutions. 


As you may have noticed from Example 2.9, it is not practical to check the 
linear independence of a set of solutions using the definition. Fortunately, 
there is a simple method to check the linear independence of solutions using 
the so-called Casoratian W(n), which we now define for the eager reader. 


Definition 2.11. The Casoratian* W (n) of the solutions z1 (n), x2(n),..., 
x,(n) is given by 


x1(n) Xo(n) sind zr(n) 
zın + 1) xo(n + 1) we) Lp (n+ 1) 
W (n) = det 
gi(ntr—1) ae(ntr—-1) ... 2-(n+r—1) 


Example 2.12. Consider the difference equation 


x(n + 3) — 7x(n+ 1) + 6zr(n) = 0. 


(a) Show that the sequences 1, (—3)”, and 2” are solutions of the equation. 
(b) Find the Casoratian of the sequences in part (a). 
Solution 


(a) Note that x(n) = 1 is a solution, since 1 — 7+ 6 = 0. Furthermore, 
x(n) = (—3)” is a solution, since 


(—3)"*? — 7(—3)” +! + 6(—3)" = (—3)"[(—27 + 21 + 6] = 0. 
Finally, x(n) = 2” is a solution, since 


(2)°+3 — 7(2)"41 + 6(2)” = 2” [8 — 14 + 6] = 0. 


‘This is the discrete analogue of the Wronskian in differential equations. 
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(b) Now, 


jean? at} ant 
aoe ge PT yet 
+)" a 


sO) Malan Goa) iat C2) kl cd cs) 9 aa 2 ha) 
(D3) +? d= 3)"") 

= —12(2)"(—3)”" — 18(2 

+ 2(2)”(—3)” + 9(2)” 

= —20(2)"(—3)”. 


ee 


Next we give a formula, called Abel’s formula, to compute the Caso- 
ratian W(n). The significance of Abel’s formula is its effectiveness in the 
verification of the linear independence of solutions. 


Lemma 2.13 (Abel’s Lemma). Let x(n), %2(n),..., 2% (n) be so- 
lutions of (2.2.7) and let W(n) be their Casoratian. Then, for n > 
no, 


W (n) = (—1)(m—"0) (i n) W (no). (2.2.10) 


1=NO 


Proof. We will prove the lemma for k = 3, since the general case may 
be established in a similar fashion. So let xı (n), x(n), and x3(n) be three 
independent solutions of (2.2.7). Then from formula (2.2.9) we have 


W(n+1)=det | xı(n+2) za(n+2) a3(n+2)]. (2.2.11) 


From (2.2.7) we have, for 1 <i < 3, 


x(n + 3) = —p3(n)a;(n) — [pı (n)xri(n + 2) + po(n)aji(n+1)}. (2.2.12) 
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Now, if we use formula (2.2.12) to substitute for x1(n + 3), zo(n + 3), 
and z3(n + 3) in the last row of formula (2.2.11), we obtain 


zın +1) to(n +1) x3(n + 1) 
x1(n + 2) x2(n + 2) x3(n + 2) 
W(n + 1) = det —p3x1(n) —p3X2(n) —p3r3(n) 


—(poai(n+1) —(pero(n+1) —(poa3(n +1) 
t+piti(n+2)) +pixe(n+2)) +pia3(n + 2)) 

(2.2.13) 
Using the properties of determinants, it follows from (2.2.13) that 


) 
zın + 1) za(n +1) x3(n + 1) 
2) 


W(n+1)=det | xı(n+2) Xo(n + 2) za(n + (2.2.14) 
—ps(n)zı(n) —ps(n)zə(n) —ps(n)zs(n) 
zıln+1) gzə(n+1) z3(n+1) 
= —p3(n) det | x(n +2) xə(n+2)  xz3(nə) 
zı(n) r2(n) za(n) 
zı(n) r2(n) za(n) 
= —p3(n)(—1)? det | zı(n +2) zə(n+2) 2x3(n+2 
zın + gza(n + gza(n + 
Thus 
W(n+1) = (—1)3p3(n)W(n). (2.2.15) 


Using formula (1.2.3), the solution of (2.2.15) is given by 


W(n) = ji nrto) W (no) = (71)? [I ps(i)W (n 


ini i=no 


This completes the proof of the lemma for k = 3. The general case is left 
to the reader as Exercises 2.2, Problem 6. 

We now examine and treat one of the special cases that arises as we try 
to apply this Casoratian. For example, if (2.2.7) has constant coefficients 
P1, P2,---,Pk, then we have 


W(n) = (1) =) pW ng). (2.2.16) 


Formula (2.2.10) has the following important correspondence. 


Corollary 2.14. Suppose that p(n) # 0 for all n > no. Then the 
Casoratian W (n) £0 for all n > no if and only if W (no) 40. 


PROOF. This corollary follows immediately from formula (2.2.10) (Exer- 
cises 2.2, Problem 7). 
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Let us have a close look at Corollary 2.14 and examine what it really says. 
The main point in the corollary is that either the Casoratian is identically 
zero (i.e., zero for all n > no, for some no) or never zero for any n > no. 
Thus to check whether W(n) Æ 0 for all n € Zt, we need only to check 
whether W(0) 4 0. Note that we can always choose the most suitable no 
and compute W (no) there. 

Next we examine the relationship between the linear independence of 
solutions and their Casoratian. Basically, we will show that a set of k so- 
lutions is a fundamental set (i.e., linearly independent) if their Casoratian 
W (n) is never zero. 

To determine the preceding statement we contemplate k solutions 


x(n), xo(n),...,£p(n) of (2.2.7). Suppose that for some constants ay, 
a2,...,a, and no E€ Zt, 
azı (n) + azzə(n) +--+ +ax(n) zg(n) = 0, for all n > no. 


Then we can generate the following k — 1 equations: 


ayxy(n + 1) + agzo(n + 1) +.. + aktk(n + 1) — 0, 


aizı(n + k — 1) + azrə(n + k — 1) +---+apzg(n+ k- 1) = 0. 


This assemblage may be transcribed as 


X(n) =0, (2.2.17) 
where 
x1(n) x9(n) a x(n) 
x(n +1) Xo(n + 1) ni xp(n+ 1) 
X(n) = , 
ai(ntk—-1) a(nt+k—-1) ... a(n+k—-1) 
i 2 
ak 


Observe that W (n) = det X (n). 

Linear algebra tells us that the vector (2.2.17) has only the trivial (or 
zero) solution (i.e., ay = a2 = ++: = ay = 0) if and only if the matrix X (n) 
is nonsingular (invertible) (i.e., det X(n) = W (n) 4 0 for all n > ng). This 
deduction leads us to the following conclusion. 
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Theorem 2.15. The set of solutions x1(n),xo(n),...,a%(n) of (2.2.7) 
is a fundamental set if and only if for some no € Z*, the Casoratian 


PROOF. Exercises 2.2, Problem 8. 


Example 2.16. Verify that {n,2”} is a fundamental set of solutions of 
the equation 

3n — 2 2 
4 u(n+1)4 k x(n) = 0. 


n—-1 


x(n + 2) ae 


Solution We leave it to the reader to verify that n and 2” are solutions of 
the equation. Now, the Casoratian of the solutions n, 2” is given by 


n 2” 
W (n) = det ae gare 
Thus 
0 1 
W (0) = det =—1]1 £0. 
(0) = de (' # 


Hence by Theorem 2.15, the solutions n, 2” are linearly independent and 
thus form a fundamental set. 


Example 2.17. Consider the third-order difference equation 


x(n + 3) + 3a(n + 2) — 4a(n + 1) — 12x(n) = 0. 


Show that the functions 2”, (—2)”", and (—3)” form a fundamental set of 
solutions of the equation. 
Solution 

(i) Let us verify that 2” is a legitimate solution by substituting x(n) = 2” 
into the equation: 


gett (3)(2”+1) — (4)(2”+1) — (12) (2”) So" (8 12 — 8 — 12] = 0. 


We leave it to the reader to verify that (—2)” and (—3)” are solutions 
of the equation. 


(ii) To affirm the linear independence of these solutions we construct the 
Casoratian 


2” Oey — (=3)" 
W(n) = det | 27+! (-2)"*! (-3 
—2) 


) 
gnt2 ( 2 n+2 (—3)"? 
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Thus 
1 1 1 
W(0)=det|2 -2 3] =-—20 #0. 
4 4 9 


By Theorem 2.15, the solutions 2”, (—2)”, and 3” are linearly independent, 
and thus form a fundamental set. 


We are now ready to discuss the fundamental theorem of homogeneous 
linear difference equations. 


Theorem 2.18 (The Fundamental Theorem). If p(n) #0 for all 
n > no, then (2.2.7) has a fundamental set of solutions for n > no. 


Proor. By Theorem 2.7, there are solutions x(n), a(n), ...,£p(n) such 
that x;(m9 +i—1) = 1, 2; (no) = zi(no +1) =--- = xi(no +i—2) = xi(no + 
i) =--- =aj(no+k—-1) =0,1 <i < k. Hence x1(no) = 1,22(m9 + 1) = 


1,23(N9 +2) = 1,...,£k(no+k—1) = 1. It follows that W (no) = det I = 1. 
This implies by Theorem 2.15 that the set {x1(n),r2(n),...,¢n(n)} is a 
fundamental set of solutions of (2.2.7). 


We remark that there are infinitely many fundamental sets of solutions 
of (2.2.7). The next result presents a method of generating fundamental 
sets starting from a known set. 


Lemma 2.19. Let x(n) and x2(n) be two solutions of (2.2.7). Then the 
following statements hold: 


(i) a(n) = xı (n) + x2(n) is a solution of (2.2.7). 


(ii) &(n) = azı (n) is a solution of (2.2.7) for any constant a. 


PROOF. (Exercises 2.2, Problem 9.) 


From the preceding lemma we conclude the following principle. 


Superposition Principle. If 21(n),x2(n),...,2,(n) are solutions of 
(2.2.7), then 
a(n) = azi (n) + agr2(n) + +--+ arær(n) 


is also a solution of (2.2.7) (Exercises 2.2, Problem 12). 

Now let {x1(n), v2(n),...,2%()} be a fundamental set of solutions of 
(2.2.7) and let x(n) be any given solution of (2.2.7). Then there are con- 
stants a1, a2,...,@p such that a(n) = Sos a;x;(n). To show this we use 
the notation (2.2.17) to write X(n)& = &(n), where 


x(n) 
a(n+1) 
&(n) = 


x(n ii —1) 
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Since X(n) is invertible (Why?), it follows that 
E= X~!(n)a(n), 
and, for n = no, 
£ = X~*(no)&(no). 
The above discussion leads us to define the general solution of (2.2.7). 


Definition 2.20. Let {x1(n),x2(n),...,¢%(m)} be a fundamental set of 
solutions of (2.2.7). Then the general solution of (2.2.7) is given by x(n) = 
— aixi(n), for arbitrary constants a;. 

It is worth noting that any solution of (2.2.7) may be obtained from the 
general solution by a suitable choice of the constants a;. 

The preceding results may be restated using the elegant language of 
linear algebra as follows: Let S be the set of all solutions of (2.2.7) with 
the operations +, - defined as follows: 

(i) (w@t+y)(n)=2(n)+y(n),  fora,yeS, neZr, 
(ii) (ax)(n) = ax(n), for x € S,a constant. 


Equipped with linear algebra we now summarize the results of this section 
in a compact form. 


Theorem 2.21. The space (S,+,-) is a linear (vector) space of dimension 
k. 


PROOF. Use Lemma 2.19. To construct a basis of S we can use the 
fundamental set in Theorem 2.18 (Exercises 2.2, Problem 11). 


Exercises 2.2 


1. Find the Casoratian of the following functions and determine whether 
they are linearly dependent or independent: 


(a) 57,3. 50+? e”, 
(b) 5%, n 5”, n? 5”. 
(c) (—2)”,2”,3. 
(d) 0,3”, 7”. 

2. Find the Casoratian W (n) of the solutions of the difference equations: 
(a) x(n +3) — 10a(n + 2) + 31z(n + 1) — 30z(n) = 0, if W (0) = 6. 
(b) x(n +3) — 3a(n + 2) + 4a(n + 1) — 12z(n) = 0, if W (0) = 26. 


3. For the following difference equations and their accompanied solutions: 


(i) determine whether these solutions are linearly independent, and 
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11. 
12. 


*13. 


14. 


15. 
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(ii) find, if possible, using only the given solutions, the general 


solution: 
(a) x(n +3) — 3z(n + 2) + 3e(n +1) — a(n) = ; Inn’, 
(b) a(n +2) +2(n) =0; cos (+) „sin (+) 


(c) x(n+3)+a(n+2)—82(n+1)—-122(n) =0; 3”, (—2)", (—2)"*8, 
(d) e(n + 4) —16a(n) =0;  2”,n2",n72”. 


. Verify formula (2.2.10) for the general case. 
. Show that the Casoratian W(n) in formula (2.2.9) may be given by 


the formula 


x1(n) x2(n) xe x(n) 
Az;(n) Azəa(n) ...  Ax(n) 
W (n) = det 
A®lai(n) A*®-lao(n) ... AFtgp(n) 


. Verify formula (2.2.16). 
. Prove Corollary 2.14. 

. Prove Theorem 2.15. 

. Prove Lemma 2.19. 


10. 


Prove the superposition principle: If x(n), zo(n),..., £p are solutions 
of (2.2.7), then any linear combination of them is also a solution of 
(2.2.7). 


Prove Theorem 2.21. 

Suppose that for some integer m > no, pe(m) = 0 in (2.2.1). 
(a) What is the value of the Casoratian for n > m? 

(b) Does Corollary 2.14 still hold? (Why?) 


Show that the equation A?y(n) = p(n)y(n + 1) has a fundamental set 
of solutions whose Casoratian W (n) = —1. 


Contemplate the second-order difference equation u(n+2)+p1(n)u(n+ 
1) + po(n)u(n) = 0. If ui(n) and u2(n) are solutions of the equation 
and W(n) is their Casoratian, prove that 


n-1 
ug(n) = u(n) ya W (r)/ui(r)ui(r +1). (2.2.18) 
r=0 
Contemplate the second-order difference equation u(n+2)— ne u(n+ 
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(a) Verify that u(n) = a is a solution of the equation. 


(b) Use formula (2.2.18) to find another solution uə(n) of the 
equation. 


16. Show that u(n) = (n+1) is a solution of the equation u(n+ 2) — u(n+ 
1) —1/(n+ 1)u(n) = 0 and then find a second solution of the equation 
by using the method of Exercises 2.2, Problem 15. 


2.3 Linear Homogeneous Equations 
with Constant Coefficients 


Consider the kth-order difference equation 
a(n+k)+pic(nt+k—1)+ poa(n+k—2)+-+++ppa(n) =0, (2.3.1) 


where the p;’s are constants and pp # 0. Our objective now is to find 
a fundamental set of solutions and, consequently, the general solution of 
(2.3.1). The procedure is rather simple. We suppose that solutions of (2.3.1) 
are in the form à”, where A is a complex number. Substituting this value 
into (2.3.1), we obtain 


AE HpaI ee ee (2.3.2) 


This is called the characteristic equation of (2.3.1), and its roots A are called 
the characteristic roots. Notice that since py 4 0, none of the characteristic 
roots is equal to zero. (Why?) (Exercises 2.3, Problem 19.) 

We have two situations to contemplate: 


Case (a). Suppose that the characteristic roots Ay, A2,..., Ax are distinct. 
We are now going to show that the set {A}, A$,..., AZ} is a fundamental 
set of solutions. To prove this, by virtue of Theorem 2.15 it suffices to show 
that W(0) 4 0, where W(n) is the Casoratian of the solutions. That is, 


1 base, ul 
` A Ne 

WO =de | A A2 oe Ak. (2.3.3) 
yn yn nih ye 


This determinant is called the Vandermonde determinant. 
It may be shown by mathematical induction that 


wo)= JJ Qj -»)- (2.3.4) 


1<i<j<k 


The reader will prove this conclusion in Exercises 2.3, Problem 20. 
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Since all the \,’s are distinct, it follows from (2.3.4) that W(0) 4 0. 
This fact proves that {A7,A¥,..., Az} is a fundamental set of solutions of 
(2.3.1). Consequently, the general solution of (2.3.1) is 


k 
x(n) = > aiA\;, a, a complex number. (2.3.5) 


i=1 


Case (b). Suppose that the distinct characteristic roots are À1, A2,..-, Ar 


with multiplicities m1, M2, ..., Mr with X;—1 m; = k, respectively. In this 
case, (2.3.1) may be written as 

(E — 4)! (E — à2)™ (E — àr) x(n) = 0. (2.3.6) 

A vital observation here is that if yı (n), Y2(n), -- -, Ym; (n) are solutions of 

(E — Ai) a(n) = 0, (2.3.7) 


then they are also solutions of (2.3.6). For if Y¥,(n) is a solution of (2.3.7), 
then (E — A;)"™ U,(n) = 0. Now 


(E= A )™ «+. (Bd) +. (B— àr) Y(n) 
= (E — M) o (E — Mi) HE = Miga) T ats 
(E — d,)'™ (E — A:)™ Y(n) = 0. 


Suppose we are able to find a fundamental set of solutions for each (2.3.7), 
1 <i <r. It is not unreasonable to expect, then, that the union of these 
r fundamental sets would be a fundamental set of solutions of (2.3.6). In 
the following lemma we will show that this is indeed the case. 

Lemma 2.22. The set Gi = {a8 Ae eon aan ae AT 
is a fundamental set of solutions of (2.3.7) where (1) = n, (3) 
n(n—1) (") = ed enre 


JI yeee r 


II 


PROOF. To show that G; is a fundamental set of solutions of (2.3.7), it 
suffices, by virtue of Corollary 2.14, to show that W (0) 4 0. But 


1 0 ay 0 

Ài 1 me 0 

A? 2); 0 

W(0) = 

mi—l (mi z 1) mi—2 1 

as 1! A; 213! --- (m; — 2)! 
Hence 
1 
w(0) = #0. 
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It remains to show that (")A/~" is a solution of (2.3.7). From equation 
(2.1.9) it follows that 


mif P n=r _ \n=r/(). Pm y.\mi n 
(B=, C) ATT = APTT (AE — Ai) @ 
= etre 7m (C) 


r 
= Aer Aes @ 
r 


=0 using (2.1.6). 


Now we are finally able to find a fundamental set of solutions. 


Theorem 2.23. The set G = U; Gi is a fundamental set of solutions 
of (2.3.6). 


PROOF. By Lemma 2.22, the functions in G are solutions of (2.3.6). Now 


1 0 fal al 0 
`i 1 yi ee 1 

W(0)=det | A 201 wae A 2X, 
ST kee DO eae 


(2.3.8) 
This determinant is called the generalized Vandermonde determinant. (See 
Appendix B.) It may be shown [76] that 


wo)= JJ @Q-Ay™™. (2.3.9) 


1<i<j<k 


As à; # àj, W(0) Æ 0. Hence by Corollary 2.14 the Casoratian W(n) 4 
0 for all n > 0. Thus by Theorem 2.15, G is a fundamental set of 
solutions. 


Corollary 2.24. The general solution of (2.3.6) is given by 


a(n) = X A? (aio + ann + aign? +-+ + aimant). (2.3.10) 
i=1 


PROOF. Use Lemma 2.22 and Theorem 2.23. 


Example 2.25. Solve the equation 


x(n + 3) — 7a(n + 2) + 16r(n + 1) — 12zr(n) = 0, 
x(0)=0, z(1)=1, «(2)=1. 
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Solution The characteristic equation is 
r3 — Tr? + 16r —12=0. 


Thus, the characteristic roots are Ay = 2 = A2, A3 = 3. 
The characteristic roots give us the general solution 


x(n) = a02” + an2” + b13”. 
To find the constants ao, a1, and b1, we use the initial data 


x(0) = ao + bı = 0, 
x(1) = 2a9 + 2a; + 3b; = 1, 
x(2) = 4ao T 8aı F 9b, ae 


Finally, after solving the above system of equations, we obtain 

a9=3, a, =2, b =-3. 
Hence the solution of the equation is given by x(n) = 3(2”)+2n(2")—3"t?. 
Example 2.26. Complex Characteristic Roots 


Suppose that the equation x(n + 2) + pya(n + 1) + pex(n) = 0 has the 
complex roots Ay = a + ib, 2 = a — ip. Its general solution would then be 


a(n) = c(a + ip)” + e2(a — ip)”. 


Recall that the point (a,3) in the complex plane corresponds to the 
complex number a+ iĝ. In polar coordinates, 


a=rcos6, GB=rsind, r= Va? + 6, 0 = tan`! (£) 
a 


Hence,° 


x(n) = c (r cos 6 + ir sin 0)” + co(r cos 0 — ir sin 0)” 
=r"[(c1 + c2) cos(né) + i(cı — c2) sin(nd)] 


= r” [a; cos(n@) + az sin(né)], (2.3.11) 
where ai = c1 + cg and ag = i(c1 — c2). 
Let 
COS w = ee a sinw = ee w = tan! (2) 
Va? + a2 fa? + a3’ ay 


5We used De Moivre’s Theorem: [r(cos @ + isin 0)]” = r”(cosn@ + isin n0). 
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Then (2.3.11) becomes 


x(n) = r”4/a? + a3[cos w cos(né) + sin w sin(n@)] 
= r”4/ a? + a3 cos(n6 — w), 
x(n) = Ar” cos(n@ — w). (2.3.12) 


Example 2.27. The Fibonacci Sequence (The Rabbit Problem) 


This problem first appeared in 1202, in Liber abaci, a book about the 
abacus, written by the famous Italian mathematician Leonardo di Pisa, 
better known as Fibonacci. The problem may be stated as follows: How 
many pairs of rabbits will there be after one year if starting with one 
pair of mature rabbits, if each pair of rabbits gives birth to a new pair 
each month starting when it reaches its maturity age of two months? (See 
Figure 2.1.) 

Table 2.2 shows the number of pairs of rabbits at the end of each month. 
The first pair has offspring at the end of the first month, and thus we have 
two pairs. At the end of the second month only the first pair has offspring, 
and thus we have three pairs. At the end of the third month, the first and 
second pairs will have offspring, and hence we have five pairs. Continuing 
this procedure, we arrive at Table 2.2. If F(n) is the number of pairs of 
rabbits at the end of n months, then the recurrence relation that represents 
this model is given by the second-order linear difference equation 


F(n+2) = F(n+1)+ F(n), F(0)=1, F(1)=2, 0<n< 10. 
This example is a special case of the Fibonacci sequence, given by 


F(n+2)=F(n+1)+ F(n), F(0) =0, F(1) =1, n> 0. 
(2.3.13) 
The first 14 terms are given by 1, 2, 3, 5, 8, 18, 21, 34, 55, 89, 144, 233, 
and 377, as already noted in the rabbit problem. 
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FIGURE 2.1. 


TABLE 2.2. Rabbits’ population size. 


5 6 7 8 9 10 11 12 
13 | 21 | 34 | 55 | 89 | 144 | 233 | 377 
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The characteristic equation of (2.3.13) is 
W-A-1=0. 
Hence the characteristic roots are a = 14V5 and 8 = 1 V5 
The general solution of (2.3.13) is 


r= a (144) a (158), n>1. (2.3.14) 


2 2 
Using the initial values F(1) = 1 and F(2) = 1, one obtains 


1 1 
G @g = —-—=. 
‘V5 o 5 
Consequently, 
1 [n+ AG-5A\]l ct 
F(n) = = —(a”" — b”). 2.3.15 
2 [(2)- (52) ] keen ea 
It is interesting to note that limp +o FitD =a = 1.618 (Exercises 2.3, 


Problem 15). This number is called the golden mean, which supposedly 
represents the ratio of the sides of a rectangle that is most pleasing to the 
eye. This Fibonacci sequence is very interesting to mathematicians; in fact, 
an entire publication, The Fibonacci Quarterly, dwells on the intricacies of 
this fascinating sequence. 


Exercises 2.3 
1. Find homogeneous difference equations whose solutions are: 


(a) 20-1 — 5nt1, 


(b) 3cos (>) -sin (=). 
(c) (n+ 2)5" sin (7). 
(d) (c1 + con + c3n?)7”. 
(e) 1+3n—5n? + 6n3. 


2. Find a second-order linear homogeneous difference equation that gen- 
erates the sequence 1, 2, 5, 12, 29, ...; then write the solution of the 
obtained equation. 


In each of Problems 3 through 8, write the general solution of the difference 
equation. 


3. a(n +2) — 16x(n) = 0. 
4. x(n +2) + 16x(n) = 0. 
5. (E —3)?(E? + 4)a(n) = 0. 
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6. A82(n) =0. 
7. (E2 +2)2x(n) = 0. 
8 
9 


. x(n +2) — 6a(n+ 1) + 142(n) = 0. 


. Consider Example 2.26. Verify that xı(n) = r” cosn and xo(n) = 
r” sinnô are two linearly independent solutions of the given equation. 


10. Consider the integral defined by 


no) = f SOS ROO a EN 
0 cos 0 — cosy 


(a) Show that Ip(p) satisfies the difference equation 
In+2(p)—2c08 PIngi(y)+in(y) =9, lo(y)=90, hly) =z. 
(b) Solve the difference equation in part (a) to find I,(y). 


11. The Chebyshev polynomials of the first and second kinds are defined, 
respectively, as follows: 


Tn(x) = cos(ncos~'(x)), U, (x) = sin[(n + 1) cos~*(a)], 


1 
vi-@ 
for |x| < 1. 

(a) Show that T(x) obeys the difference equation 

Tn42(£) — 2£Tn41 (£) + T,(x) = 0, To(x) = 1, Ti(x) =a. 
(b) Solve the difference equation in part (a) to find Tp (£x). 
(c) Show that U,,(a) satisfies the difference equation 

Un+2(@)—-22U yn 41(x)+U n(x) = 0, Uo(x) = 1, Ui (x) = 2a. 
(d) Write down the first three terms of T,,(x) and Un (x). 
(e) Show that T,,(cos 6) = cosn@ and that 

Uy (cos 0) = (sin[(n + 1)6])/sin 6. 


12. Show that the general solution of 


u(n+ 2) — 2sa(n +1) + a(n) =0, |s| <1, 
is given by 


x(n) = 4 T,(s) + c2U p(s). 


13. Show that the general solution of x(n + 2) + pia(n + 1) + pox(n) = 
0, po > 0, p? < 4ps, is given by x(n) = r” [c1 Ty, (s) +C2Un_1(s)], where 


r = ,/p2 and s = P,/(2,/p2). 
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14. 


15. 
16. 


17. 


*18. 


19. 


20. 


21. 


22. 
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The Lucas numbers Ln are defined by the difference equation 
In4e2=Ln4itin, n20, Lo=2, L, =1. 


Solve the difference equation to find Ln. 


Show that lim, ..(F(n + 1))/F(n) = a, where a = (1+ V5)/2. 


Prove that consecutive Fibonacci numbers F(n) and F(n + 1) are 
relatively prime. 


(a) Prove that F(n) is the nearest integer to 1/V5((1 + V5)/2)”. 
(b) Find F(17), F(18), and F'(19), applying part (a). 


Define x = a mod p if x = mp + a. Let p be a prime number with 
p> od. 


(a) Show that F(p) = 5-)/? mod p. 


(b) Show that F(p) = +1 mod p. 


Show that if pp # 0 in (2.3.1), then none of its characteristic roots is 
equal to zero. 


Show that the Vandermonde determinant (2.3.3) is equal to 
J[ œ- 
1<i<j<k 


Find the value of the n x n tridiagonal determinant 


bao... 0 0 

aba... 0 0 

O ab... 00 
D(n) = 

000... ba 

0 0 0... ab 


Find the value of the n x n tridiagonal determinant 


a bo... 0 0 
ca bp... 00 
0 ca... 0 0 
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2.4 Linear Nonhomogeneous Equations: Method 
of Undetermined Coefficients 


In the last two sections we developed the theory of linear homogeneous 
difference equations. Moreover, in the case of equations with constant co- 
efficients we have shown how to construct their solutions. In this section 
we focus our attention on solving the Ath-order linear nonhomogeneous 
equation 


y(n + k) + pi(n)y(n + k= 1) +--+ pe(n)y(n) = g(n), (2.4.1) 


where p(n) # 0 for all n > no. The sequence g(n) is called the forcing 
term, the external force, the control, or the input of the system. As we will 
discuss later in Chapter 6, equation (2.4.1) represents a physical system in 
which g(n) is the input and y(n) is the output (Figure 2.2). Thus solving 
(2.4.1) amounts to determining the output y(n) given the input g(n). We 
may look at g(n) as a control term that the designing engineer uses to force 
the system to behave in a specified way. 

Before proceeding to present general results concerning (2.4.1) we would 
like to raise the following question: Do solutions of (2.4.1) form a vector 
space? In other words, is the sum of two solutions of (2.4.1) a solution of 
(2.4.1)? And is a multiple of a solution of (2.4.1) a solution of (2.4.1)? Let 
us answer these questions through the following example. 


Example 2.28. Contemplate the equation 
y(n + 2) — y(n + 1) — 6y(n) = 5(3”). 


(a) Show that y(n) = n(3"~+) and yo(n) = (1 + n)3"~? are solutions of 
the equation. 


(b) Show that y(n) = y2(n) — yi(n) is not a solution of the equation. 


(c) Show that y(n) = en(3”"~*) is not a solution of the equation, where c 
is a constant. 


Solution 

(a) The verification that yı and y2 are solutions is left to the reader. 

(b) y(n) = yo(n)—yi(n) = 3°71. Substituting this into the equation yields 
gut) — 3” — 637-1 = 3"(8 — 1 — 2] = 0 ¥ 568”). 

(c) By substituting for y(n) into the equation we see easily that y(n) is 


not a solution. 
input gi) —>| system | output y(n) 


FIGURE 2.2. Input-output system. 
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Conclusion 


(i) From the above example we conclude that in contrast to the situation 
for homogeneous equations, solutions of the nonhomogeneous equa- 
tion (2.4.1) do not form a vector space. In particular, neither the sum 
(difference) of two solutions nor a multiple of a solution is a solution. 


(ii) From part (b) in Example 2.28 we found that the difference of the 
solutions yo(n) and y(n) of the nonhomogeneous equation is actually 
a solution of the associated homogeneous equation. This is indeed true 
for the general nth-order equation, as demonstrated by the following 
result. 


Theorem 2.29. If yi(n) and yo(n) are solutions of (2.4.1), then x(n) = 
yi(n) — y2(n) is a solution of the corresponding homogeneous equation 


a(n+k)+pi(n)a(n+k—1)+---+pp(n)x(n) = 0. (2.4.2) 


ProoF. The reader will undertake the justification of this theorem in 
Exercises 2.4, Problem 12. 


It is customary to refer to the general solution of the homogeneous equa- 
tion (2.4.2) as the complementary solution of the nonhomogeneous equation 
(2.4.1), and it will be denoted by y-(n). A solution of the nonhomoge- 
neous equation (2.4.1) is called a particular solution and will be denoted 
by yp(n). The next result gives us an algorithm to generate all solutions of 
the nonhomogeneous equation (2.4.1). 


Theorem 2.30. Any solution y(n) of (2.4.1) may be written as 


where {x1(n),v2(n),...,a%(n)} is a fundamental set of solutions of the 
homogeneous equation (2.4.2). 


PROOF. Observe that according to Theorem 2.29, y(n) — yp(n) is a 
solution of the homogeneous equation (2.4.2). Thus y(n) — yp(n) = 
eae a;x;(n), for some constants ai. 

The preceding theorem leads to the definition of the general solution of 
the nonhomogeneous equation (2.4.1) as 


y(n) = ye(m) + yp(n). (2.4.3) 


We now turn our attention to finding a particular solution yp of 
nonhomogeneous equations with constant coefficients such as 


y(n +k) +piy(nt+k—1) +--+ +pey(n) = g(n). (2.4.4) 
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Because of its simplicity, we use the method of undetermined coefficients 
to compute yp. 

Basically, the method consists in making an intelligent guess as to the 
form of the particular solution and then substituting this function into the 
difference equation. For a completely arbitrary nonhomogeneous term g(n), 
this method is not effective. However, definite rules can be established for 
the determination of a particular solution by this method if g(n) is a linear 
combination of terms, each having one of the forms 


a", sin(bn), cos(bn), or n*, (2.4.5) 
or products of these forms such as 
a” sin(bn), anë, a” n* cos(bn),.... (2.4.6) 


Definition 2.31. A polynomial operator N(E), where E is the shift 
operator, is said to be an annihilator of g(n) if 


N(E)g(n) = 0. (2.4.7) 


In other words, N(£) is an annihilator of g(n) if g(n) is a solution of 
(2.4.7). For example, an annihilator of g(n) = 3” is N(E) = E — 3, since 
(E — 3)y(n) = 0 has a solution y(n) = 3”. An annihilator of g(n) = cos “5 
is N(E) = F? +1, since (E? + 1)y(n) = 0 has a solution y(n) = cos 4. 
Let us now rewrite (2.4.4) using the shift operator Æ as 


P(E)y(n) = g(r), (2.4.8) 


where p(E) = E} + pi E! + po ER? +--+ + ppl. 
Assume now that N(E) is an annihilator of g(n) in (2.4.8). Applying 
N(E) on both sides of (2.4.8) yields 


N(E)p(E)y(n) = 0. (2.4.9) 
Let A1, À2,..., Ak be the characteristic roots of the homogeneous equation 
p(B)y(n) = 0, (2.4.10) 

and let j11, H2,..., Hk be the characteristic roots of 
N(E)y(n) = 0. (2.4.11) 


We must consider two separate cases. 


Case 1. None of the 2,’s equals any of the u,;’s. In this case, write y,(n) as 
the general solution of (2.4.11) with undetermined constants. Substituting 
back this “guesstimated” particular solution into (2.4.4), we find the values 
of the constants. Table 2.3 contains several types of functions g(n) and their 
corresponding particular solutions. 


Case 2. A; = uj for some i,j. In this case, the set of characteristic roots 
of (2.4.9) is equal to the union of the sets {A;}, {u;} and, consequently, 
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TABLE 2.3. Particular solutions yp(n). 


g(n) Yp(m) 
a” ca” 
në co + an+- + ceken" 

nta” coa” + cana” +--+» + centa” 

sin bn, cos bn cı sin bn + cz cos bn 
a” sin bn, a” cos bn (cı sin bn + c2 cos bn)a” 
an sin bn,a"n* cosbn | (co + cin +---+cKn”)a” sin(bn) 
+ (do + din +---dyn*)a” cos(bn) 


contains roots of higher multiplicity than the two individual sets of char- 
acteristic roots. To determine a particular solution y,(n), we first find the 
general solution of (2.4.9) and then drop all the terms that appear in ye(n). 
Then proceed as in Case 1 to evaluate the constants. 


Example 2.32. Solve the difference equation 


y(n + 2) + y(n + 1) — 12y(n) = n2”. (2.4.12) 
Solution The characteristic roots of the homogeneous equation are A; = 3 
and AQ = —4. 
Hence, 


y(n) = &3” + €2(—4)”. 


Since the annihilator of g(n) = n2” is given by N(E) = (E — 2)? (Why?), 
we know that u = u2 = 2. This equation falls in the realm of Case 1, since 
Ai Æ uj, for any i,j. So we let 


Yp(n) = a12” + agn2”. 
Substituting this relation into equation (2.4.12) gives 
a1 2+? + ao(n + 2)2"4? + a12"+1 + ag(n + 1)2"41 — 12012” — 12a9n2” = n2”, 
(10a — 6a1)2” — bagn?” = n2”. 


Hence 
10a2 — 6aı =0 and — 6a = 1, 
or 
—5 —1 
a — a —. 
1 18 ’ 2 6 
The particular solution is 
—5 1 
= — 9” Ze gn 
wln) = Tea" — gn", 
and the general solution is 
5 1 


y(n) = c13” + c2(—4)” 2” gre” 
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Example 2.33. Solve the difference equation 


(E — 3)(E + 2)y(n) = 5(3”). (2.4.13) 
Solution The annihilator of 5(3”) is N(E) = (E — 3). Hence, pı = 3. The 
characteristic roots of the homogeneous equation are A; = 3 and Az = —2. 
Since A; = u1, we apply the procedure for Case 2. 
Thus, 
(E — 3)?(E+2)y(n) =0. (2.4.14) 


Now ye(n) = c13” + co(—2)”. 
We now know that the general solution of (2.4.14) is given by 


y(n) = (ay + agn)3” + a3(—2)”. 


Omitting from 9(n) the terms 3” and (—2)” that appeared in ye(n), we set 
Yp(n) = agn3”. Substituting this y,(n) into (2.4.13) gives 
) 


ag(n + 2)3"*? — ao(n + 1)3"*! + 6agn3” = 5.3”, 
or 


aû2 = —. 


3 
Thus yp(n) = n3”"~!, and the general solution of (2.4.13) is 


y(n) = c13” + co(—2)” + n3"71. 


Example 2.34. Solve the difference equation 


y(n + 2) + 4y(n) = 8(2”) cos (+). (2.4.15) 
Solution The characteristic equation of the homogeneous equation is 
X +4=0. 


The characteristic roots are 


Thus r = 2,6 = 7/2, and 
ye(n) = 2” (a cos (+) + co sin (5) ; 


Notice that g(n) = 2” cos (%*) appears in ye(n). Using Table 2.3, we set 
Yp(n) = 2” (ancos (>) + bnsin (=)) ; (2.4.16) 
Substituting (2.4.16) into (2.4.15) gives 


ar? [a(n + 2) cos (> n) H b(n + 2) sin (S+7)] 


+ (4)2” [an cos (=) + bnsin (>) = 8(2") cos (+) : 
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Replacing cos((nm)/2 + t) by —cos((n7)/2), and sin((nm)/2 + r) by 
—sin((n7)/2) and then comparing the coefficients of the cosine terms leads 
us to a = —1. Then by comparing the coefficients of the sine terms, we 
realize that b = 0. 

By substituting these values back into (2.4.16), we know that 


Yp(n) = —2”n cos (+) ; 


and the general solution of (2.4.15), arrived at by adding ye(n) and y,(n), 
is 


A nT _ [NT nT 
y(n)=2 (c1 cos S + ca sin ( Z) ncos ( 5 )). 


Exercises 2.4. 


For Problems 1 through 6, find a particular solution of the difference 
equation. 


1. y(n +2) — 5y(n + 1) + y(n) = 14 n. 

2. y(n + 2) + 8y(n+ 1) + 12y(n) = e”. 

3. y(n + 2) — 5y(n + 1) + 4y(n) = 4" — n?. 
4. y(n + 2) + 8y(n + 1) + Ty(n) = ne”. 

5. y(n + 2) — y(n) = ncos (+). 


6. (E? + 9)?y(n) = sin (>) — cos (=). 
For Problems 7 through 9 find the solution of the difference equation. 

7. A?y(n) = 16, y(0) = 2, y(1) =3. 

8. A?y(n) + Ty(n) = 2sin (TE), (0) =0, y(t) = 1. 

9. (E-3)(E?+1)y(n)=3", (0) =0, y@)=1, 2) = 3. 
For Problems 10 and 11 find the general solution of the difference equation. 
10. y(n + 2) — y(n) = n2” sin (>). 

11. y(n +2) + 8y(n + 1) + Ty(n) = n2”. 
12. Prove Theorem 2.29. 


13. Consider the difference equation y(n+2)+piy(n+ 1) +poy(n) = g(n), 
where p? < 4p and 0 < po < 1. Show that if yı and yz are two 
solutions of the equation, then y(n) — yo(n) > 0 as n > on. 


14. Determine the general solution of y(n+2)+A?y(n) = > 
where A > 0 and AA mz7,m=1,2,...,N. 


N ; 
nai 4m Sin(mmn), 
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15. Solve the difference equation 
1 if0<n< 2, 
—1 ifn>2, 


y(n +2) + y(n) = 


with y(0) = 0 and y(1) = 1. 


2.4.1 The Method of Variation of Constants (Parameters) 
Contemplate the second-order nonhomogeneous difference equation 
y(n +2) + pi(n)y(n + 1) + paln)y(n) = g(n) (2.4.17) 
and the corresponding homogeneous difference equation 
y(n + 2) + pr(n)y(n + 1) + po(n)y(n) = 0. (2.4.18) 


The method of variation of constants is commonly used to find a particular 
solution yp(n) of (2.4.17) when the coefficients pi(n) and po(n) are not 
constants. The method assumes that a particular solution of (2.4.17) may 
be written in the form 


y(n) = ua(r)yr(m) + uz(n)y2(n), (2.4.19) 


where yı (n) and y2(n) are two linearly independent solutions of the homo- 
geneous equation (2.4.18), and u1(n), u2(n) are sequences to be determined 
later. 


16. (a) Show that 
y(n + 1) = ui (n)yi(n + 1) + wa(n)yo(n + 1) 
+ Aui(n)yi(m + 1) + Aue(n)yo(n + 1). (2.4.20) 
(b) The method stipulates that 
Aui(n)yi(m + 1) + Aue(n)yo(n + 1) = 0. (2.4.21) 
Use (2.4.20) and (2.4.21) to show that 
y(n + 2) = uy(n)yi(n + 2) + u2(n)yo(n + 2) 
+ Aui(n)yi(n + 2) + Aue(n)yo(n + 2). 


(c) By substituting the above expressions for y(n), y(n+1), and y(n+ 
2) into (2.4.17), show that 


Aui(n)yi(m + 2) + Aue(n)yo(n + 2) = g(n). (2.4.22) 
(d) Using expressions (2.4.21) and (2.4.22), show that 


_ —g(n)yo(n +1) yo w9(r)ya(r + 1) 
Au (n) = Want) ” u(n) X ARAT 
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17. 


18. 


19. 


20. 
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g(n)yi(n + 1) g(r)yi(r +1) 
Atl) = Watt)” -S ne Wert” 


(2.4.24) 
where W(n) is the Casoratian of y;(m) and yo(n). 


Use formulas (2.4.23) and (2.4.24) to solve the equation 
y(n + 2) — Ty(n + 1) + 6y(n) = 
Use the variation of constants method to solve the initial value problem 
y(n + 2) — 5y(n + 1) +6y(n)=2"”, -y(1) = y(2) = 0. 


Use Problem 16(d) to show that the unique solution of (2.4.17) with 
y(0) = y(1) = 0 is given by 


ae 5 u(r + Dyn) — yo(r + Dyi(n) 


W(r +1) 
Consider the equation 
x(n +1) = ax(n) + f(n). (2.4.25) 
(a) Show that 
a(n) = a” |a(0) 4 PO) + n +4 u E (2.4.26) 


is a solution of (2.4.25). 


(b) Show that if |a| < 1 and {f(n)} is a bounded sequence, i.e., 
|f(n)| < M, for some M > 0, n € Z”, then all solutions of 
(2.4.25) are bounded. 


(c) Suppose that a > 1 and {f(n)} is bounded on Z*. Show that if 


we choose 
x)= — e Og AO oS AD. 
= 02.4.27) 


then the solution x(n) given by (2.4.26) is bounded on Z*. Give 
an explicit expression for x(n) in this case. 


(d) Under the assumptions of part (c), show that for any choice 
of x(0), excepting that value given by (2.4.27), the solution of 
(2.4.25) is unbounded. 


2.5 Limiting Behavior of Solutions 91 
2.5 Limiting Behavior of Solutions 


To simplify our exposition we restrict our discussion to the second-order 
difference equation 


y(n + 2) + pry(n + 1) + poy(n) = 0. (2.5.1) 


Suppose that A; and Az are the characteristic roots of the equation. Then 
we have the following three cases: 


(a) Ay and A2 are distinct real roots. Then y(n) = A} and yo(n) = A} are 
two linearly independent solutions of (2.5.1). If [Ai] > |Az|, then we 
call y(n) the dominant solution, and àı the dominant characteristic 
root. Otherwise, y2(n) is the dominant solution, and Ag is the dominant 
characteristic root. We will now show that the limiting behavior of the 
general solution y(n) = aA} + a2A}¥ is determined by the behavior 
of the dominant solution. So assume, without loss of generality, that 
|A1| > |Ag|. Then 


Since 


it follows that 


Consequently, limno y(n) = limp aiA?. There are six different 
situations that may arise here depending on the value of A (see Figure 
2.3). 


1. Ay > 1: The sequence {a,A77} diverges to co (unstable system). 
2. àı = 1: The sequence {a,A7'} is a constant sequence. 


3. 0 < Ay < 1: The sequence {a1Aj'} is monotonically decreasing to 
zero (stable system). 

4. —1 < A; < 0: The sequence {a;A7} is oscillating around zero (i.e., 
alternating in sign) and converging to zero (stable system). 


5. Ay = —1: The sequence {a1A]} is oscillating between two values 
a, and —ay,. 


6. Ai < —1: The sequence {a,A7?} is oscillating but increasing in 
magnitude (unstable system). 
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FIGURE 2.3. (n, y(n)) diagrams for real roots. 
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y(n) y(n) 


(2) (1) 


FIGURE 2.4. (n, y(n)) diagrams for comples roots. 


(b) Ay = Ag =A. 
The general solution of (2.5.1) is given by y(n) = (a1 +a2n)X". Clearly, 
if |A| > 1, the solution y(n) diverges either monotonically if A > 1 or by 
oscillating if A < —1. However, if |A| < 1, then the solution converges 
to zero, since limpo nA” = 0 (Why?). 


(c) Complex roots: 41 = a+ if and A» = a — if, where 8 Æ 0. 
As we have seen in Section 2.3, formula (2.3.12), the solution of (2.5.1) 
is given by y(n) = ar” cos(n@ — w), where 


r= ya + B?, 8 = tan”! (£) . 


The solution y(n) clearly oscillates, since the cosine function oscillates. 
However, y(n) oscillates in three different ways depending on the lo- 
cation of the conjugate characteristic roots, as may be seen in Figure 
2.4. 


1. r > 1: Here Ay and àz = À; are outside the unit circle. Hence y(n) 
is oscillating but increasing in magnitude (unstable system). 


2. r= 1: Here A; and Az = 1, lie on the unit circle. In this case y(n) 
is oscillating but constant in magnitude. 


3. r <1: Here à; and àz = A lie inside the unit disk. The solution 
y(n) oscillates but converges to zero as n — co (stable system). 


Finally, we summarize the above discussion in the following theorem. 
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Theorem 2.35. The following statements hold: 


(i) All solutions of (2.5.1) oscillate (about zero) if and only if the 
characteristic equation has no positive real roots. 


(ii) All solutions of (2.5.1) converge to zero (i.e., the zero solution is 
asymptotically stable) if and only if max{|A4], |A2|} < 1. 


Next we consider nonhomogeneous difference equations in which the 
input is constant, that is, equations of the form 


y(n +2) + piy(n +1) + poy(n) = M, (2.5.2) 


where M is a nonzero constant input or forcing term. Unlike (2.5.1), the 
zero sequence y(n) = 0 for all n € Z* is not a solution of (2.5.2). Instead, 
we have the equilibrium point or solution y(n) = y*. From (2.5.2) we have 


y* + piy* + poy* = M, 


or 
M 


er 2.5.3 
1+p1+ pe ( ) 


Thus yp(n) = y* is a particular solution of (2.5.2). Consequently, the 
general solution of (2.5.2) is given by 


y(n) = y* + yen). (2.5.4) 


* 


It is clear that y(n) > y* if and only if ye(n) > 0 as n — oo. Furthermore, 
y(n) oscillates? about y* if and only if y.(n) oscillates about zero. These 
observations are summarized in the following theorem. 


Theorem 2.36. The following statements hold: 


(i) All solutions of the nonhomogeneous equation (2.5.2) oscillate about 
the equilibrium solution y* if and only if none of the characteristic 
roots of the homogeneous equation (2.5.1) is a positive real number. 


(ii) All solutions of (2.5.2) converge to y* as n > œ if and only if 
max{|\4], |Ao|} < 1, where 1 and Az are the characteristic roots of 
the homogeneous equation (2.5.1). 


Theorems 2.35 and 2.36 give necessary and sufficient conditions under 
which a second-order difference equation is asymptotically stable. In many 
applications, however, one needs to have explicit criteria for stability based 
on the values of the coefficients pı and p2 of (2.5.2) or (2.5.1). The following 
result provides us with such needed criteria. 


We say y(n) oscillates about y* if y(n) — y* alternates sign, i.e., if y(n) > y*, 
then y(n + 1) < y*. 
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Theorem 2.37. The conditions 
1+ pit p2 > 0, 1— pi + p2 > 0, 1—po>0 (2.5.5) 


are necessary and sufficient for the equilibrium point (solution) of equations 
(2.5.1) and (2.5.2) to be asymptotically stable (i.e., all solutions converge 
to y*). 

PROOF. Assume that the equilibrium point of (2.5.1) or (2.5.2) is asymp- 
totically stable. In virtue of Theorems 2.35 and 2.36, the roots Ai, A2 of 
the characteristic equation A? + p1À + p2 = 0 lie inside the unit disk, i.e., 
|A1| < 1 and |A2| < 1. By the quadratic formula, we have 


—pi+Vp—4 -pı — V —4 
ye oes po and as EEE (2.5.6) 


2 


Then we have two cases to consider. 


Case 1. 1,2 are real roots, i.e., p? — 4p2 > 0. From formula (2.5.6) we 


have 
—2 < —pı + 4 pî — 4p2 < 2, 
—2 + pı < y pî — 4p2 < 2 + pı. (2.5.7) 


Similarly, one obtains 


—2 + pı < — y p] — 4p2 < 2 + pı. (2.5.8) 


Squaring the second inequality in expression (2.5.7) yields 
1 + pı + p2 > 0. (2.5.9) 
Similarly, if we square the first inequality in expression (2.5.8) we obtain 


1 — pı + p2 > 0. (2.5.10) 


Now from the second inequality of (2.5.7) and the first inequality of (2.5.8) 
we obtain 


2+pı>0 and 2—p,>0 or |pı|<2 


since p? — 4p2 > 0, p2 < p?/4 < 1. This completes the proof of (2.5.5) in 
this case. 


Case 2. 1 and àz are complex conjugates, i.e., p? — 4p2 < 0. In this case 


we have 
—pı 1 
Ai2 = za T 3 V 4P2 — p?. 


Moreover, since p? < 4po, it follows that —2,/pz < pı < 2,/pz. Now |Ai|? = 
2 2 
Puy T — PL = pə. Since |Ai| < 1, it follows that 0 < pə < 1. 
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Hence to show that the first two inequalities of (2.5.5) hold we need to 
show that the function f(z) = 1+ a2 —2,/x > 0 for x € (0,1). Observe 
that f(0) = 1, and f'(x) =1- wee Thus v = 1 is a local minimum as f(x) 
decreases for x € (0,1). Hence f(x) > 0 for all x € (0,1). 

This completes the proof of the necessary conditions. The converse is left 
to the reader as Exercises 2.5, Problem 8. 


Example 2.38. Find conditions under which the solutions of the equation 
y(n + 2)—a(l+ B)y(n+1)+afy(n)=1, a8 >0, 


(a) converge to the equilibrium point y*, and 


(b) oscillate about y*. 


Solution Let us first find the equilibrium point y*. Be letting y(n) = y* in 
the equation, we obtain 
1 
pt See a*l 
l-a 
(a) Applying condition (2.5.5) to our equation yields 
a<l, 1l+a+t+2afZ > 0, af <l. 


Clearly, the second inequality 1+a+2a( > 0 is always satisfied, since 
a, 3 are both positive numbers. 


The solutions are oscillatory about y* if either A1, A2 are negative real 
numbers or complex conjugates. In the first case we have 
4p 


a(1 + By? > 408, or a> (+ 8)?’ 


— 
o` 
4 


and 
a(1+ 8) <9, 


which is impossible. Thus if a > 48/(1 + 3)?, we have no oscillatory 
solutions. 


Now, A; and Az are complex conjugates if 


46 
2 2 
Hence all solutions are oscillatory if 
46 
< : 
*S + BP 


For the treatment of the general kth-order scalar difference equations, the 
reader is referred to Chapter 4, on stability, and Chapter 8, on oscillation. 
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Exercises 2.5. 


In Problems 1 through 4: 


(a) Determine the stability of the equilibrium point by using Theorem 2.35 
or Theorem 2.36. 


(b) Determine the oscillatory behavior of the solutions of the equation. 


l. 
2. 


10. 


11. 


#12: 


y(n + 2) — 2y(n + 1) + 2y(n) = 0. 


y(n + 2) + ivn) = 3. 
1 


. y(nt+2)+y(n+1)4 5y(n) = 5. 


. y(n + 2) — 5y(n + 1) + 6y(n) = 0. 


. Determine the stability of the equilibrium point of the equations 


in Problems 1 through 4 by using Theorem 2.37. 


. Show that the stability conditions (2.5.5) for the equation y(n + 


2) — ay(n + 1) + By(n) = 0, where a, @ are constants, may be 
written as 


-1-B<a<1+68, B<1. 


. Contemplate the equation y(n+2)—piy(n+1)—pey(n) = 0. Show 


that if |p1| + |p2| < 1, then all solutions of the equation converge 
to zero. 


. Prove that conditions (2.5.5) imply that all solutions of (2.5.2) 


converge to the equilibrium point y*. 


. Determine conditions under which all solutions of the difference 


equation in Problem 7 oscillate. 


Determine conditions under which all solutions of the difference 
equation in Problem 6 oscillate. 


Suppose that p is a real number. Prove that every solution of the 
difference equation y(n + 2) — y(n + 1) + py(n) = 0 oscillates if 
and only if p > L, 


Prove that a necessary and sufficient condition for the asymptotic 
stability of the zero solution of the equation 


y(n + 2) + piy(n +1) + poy(n) = 0 


\pil < 1+ po <2. 
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13. Determine the limiting behavior of solutions of the equation 


y(n + 2) = ac + ap(y(n + 1) — y(n)) 


if: 

ü ap=1, 
(ii) aß =2, 
(il) a8 = 5, 


provided that a, 6, and c are positive constants. 
14. If pı > 0 and p2 > 0, show that all solutions of the equation 
y(n + 2) + piy(n + 1) + poy(n) =0 
are oscillatory. 


15. Determine the limiting behavior of solutions of the equation 


B B 
y(n + 2) — ~y(n + 1) + —y(n) =0, 
a a 
where a and ĝ are constants, if: 
(i) £ > 4a, 
(ii) B < 4a. 


2.6 Nonlinear Equations Transformable 
to Linear Equations 


In general, most nonlinear difference equations cannot be solved explic- 
itly. However, a few types of nonlinear equations can be solved, usually by 
transforming them into linear equations. In this section we discuss some 
tricks of the trade. 


Type I. Equations of Riccati type: 


x(n + 1)a(n) + p(n)a(n +1) + q(n)a(n) = 0. (2.6.1) 
To solve the Riccati equation, we let 
1 
2(n) = ag 


in (2.6.1) to give us 
q(n)z(n + 1) + p(n)z(n) +1 =0. (2.6.2) 
The nonhomogeneous equation requires a different transformation 


y(n + 1)y(n) + p(n)y(n + 1) + a(n)y(n) = g(r). (2.6.3) 
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If we let y(n) = (z(n + 1)/z(n)) — p(n) in (2.6.3) we obtain 
a(ma+ 2) + (a(n) — pln -+ 1))2(n+ 1) — (o(n) + pln)a(n))2(n) = 0. 


Example 2.39. The Pielou Logistic Equation 


The most popular continuous model of the growth of a population is the 
well-known Verhulst—Pearl equation given by 


x'(t) = x(t)[a — ba(t)], a,b >Q, (2.6.4) 


where x(t) is the size of the population at time ¢; a is the rate of the growth 
of the population if the resources were unlimited and the individuals did 
not affect one another, and —ba?(t) represents the negative effect on the 
growth due to crowdedness and limited resources. The solution of (2.6.4) 
is given by 
a/b 
t) = — 
aXe) 1+ (e= /cb) 
Now, 
a/b 
1+ (e~(t+1) /cb) 
e“ (a/b) 
1+ (e7 /cb) + (e° — 1) 

Dividing by [1 + (e~“/cb)], we obtain 


l _ e*x(t) 
Tr ates 
or 
aan) 
x(n + 1) [r+ Ba(n))’ (2.6.5) 


where a = e“ and 8 = 2(e*— 1). 
This equation is titled the Pielou logistic equation. 


Equation (2.6.5) is of Riccati type and may be solved by letting x(n) = 
1/z(n). This gives us the equation 


Ant) = ren) + Ê 


whose solution is given by 
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x(n+1) 


x(n) 
0.5 


FIGURE 2.5. Asymptotically stable equilibrium points. 


Thus 
a” (a — 1)/[8a" + c(a — 1)- 6] ifaFl, 
s(n)=4 1 TE 
a on ifa=1. 
Hence 
al ifa #1, 
lim a(n) = 
n= 0 ifa=1. 


This conclusion shows that the equilibrium point (œ — 1)/G is globally 
asymptotically stable if a 4 1. Figure 2.5 illustrates this for a = 3, 6=1, 
and «(0) = 0.5. 


Type II. Equations of general Riccati type: 


z(n+1)= E a (2.6.6) 
such that c(n) 4 0,a(n)d(n) — b(n)c(n) # 0 for all n > 0. 
To solve this equation we let 
y(n+1) 
c(n)a(n) + d(n) = G0 (2.6.7) 


Then by substituting 
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into (2.6.6) we obtain 


y(n + 2) d(n + 1) 
c(n+ 1)y(n+1) c(in+1) y(n + 1) 


This equation simplifies to 


y(n + 2) + pı(n)y(n + 1) + p2(n)y(n) = 0, 


PARE S E (2.6.8) 
where 
pi(n) = odei x (n)e(n + 1) 
poln) = (a(n)d(n) — b(n)c(n)) ah 


Example 2.40. Solve the difference equation 

Lay) _ 2u(n) +3 

x(n T J= 3x(n) T3 

Solution Here a = 2, b = 3,c = 3, and d = 2. Hence ad — bc Æ 0. Using the 
transformation 


y(n + 1) 


32(n) +2 = (2.6.9) 


we obtain, as in (2.6.8), 
y(n + 2) —4y(n+1)—5y(n)=0,  y(0)=1,  y(1) = 3z(0) + 2, 


with characteristic roots A; = 5,Ag = —1. 
Hence 


y(n) = 15" + e9(-1)”. (2.6.10) 
From formula (2.6.9) we have 


n(n) = but) 21 eyd"+1 4 e(-1)"+! 2 
~ 3 y(n) 3 3 ab” + e2(—1)" 3 
) 
) 


_ (a5” = e(-1)") _ 5" = e(-1)" 
(c15” + c2(—1)”) 5n + c(—1)”’ 


where 


Type III. Homogeneous difference equations of the type 
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ae to convert such an equation to a 


linear equation in z(n), thus allowing it to be solved. 


Use the transformation z(n) = 


Example 2.41. Solve the difference equation 


x(n +1) — 3a(n + 1)x(n) + 2z?(n) = 0. (2.6.11) 
Solution Dividing by x?(n), equation (2.6.11) becomes 
a(n+1)]? x(n+ 1) 
+2=0, 2.6.12 
aAa ra 
which is of Type III. 
Letting z(n) = a) in (2.6.12) creates 


z*(n) — 3z(n) +2 =0. 
We can factor this down to 
[z(n) — 2][z(m) — 1] = 0, 


and thus either z(n) = 2 or z(n) = 1. 
This leads to 


a(n+1)=2¢(n) or a(n+1)=2(n). 


Starting with (0) = zo, there are infinitely many solutions x(n) of (2.6.11) 
of the form 


£0,-++,£0; 2L0,.--, 220; 27%0,...,2729;....7 
Type IV. Consider the difference equation of the form 
(y(n + k))™ (y(n + k — 1)) +++ (y(n) ™= = g(n). (2.6.13) 
Let z(n) = Iny(n), and rearrange to obtain 
ryz(nt+k)+rez(n+kh—1)+---+rpg4i2(n) = Ing(n). (2.6.14) 
Example 2.42. Solve the difference equation 
x?(n+ 1) 
= 3-55 2.6.1 
x(n + 2) An) (2.6.15) 


Solution Let z(n) = ln a(n) in (2.6.15). Then as in (2.6.12) we obtain 
z(n + 2) — 2z(n+ 1) + 2z(n) = 0. 


The characteristic roots are \y = 1+i7,A42 = 1 — i. 
Thus, 


2(n) = (2)"/? [ex cos (=) + csin (=) : 


TThis solution was given by Sebastian Pancratz of the Technical University of 
Munich. 
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Therefore, 


x(n) = exp lay"? {er cos (+) + c2 sin (+) \| ; 


Exercises 2.6 


1. Find the general solution of the difference equation 


15. 
16. 


. Solve y(n + 1) =5 - 


. Solve a(n + 1) = 


y?(n + 1) — 2y(n + 1y(n) — 3y?(n) = 0. 


. Solve the difference equation 


y?(n +1) — (2+ n)y(n + 1)y(n) + 2ny?(n) = 0. 


. Solve y(n + L)y(n) — y(n + 1) + y(n) = 0. 


| Solve y(n + Ly(n) — Sy(n +1) + culm) = Š 
6 
y(n) 
a(n) +a 
met en 


. Solve x(n +1) = x?(n). 


. Solve the logistic difference equation 


x(n+ 1) = 22(n)(1 — x(n)). 


. Solve the logistic equation 


x(n +1) = 4a(n)[1 — x(n). 


. Solve a(n +1) = 5 (a(n) - z Jaro 


2 x(n) 

. Solve y(n + 2) = y? (n + 1)/y?(n). 
, _ 2x(n) +4 

. Solve x(n + 1) = oC ans 
gia 22n) 

. Solve y(n + 1) Xi — y(n)" 
? _ 2x(n) 

. Solve a(n + 1) = is 

Solve y(n + 1) = 2y(n)./1 — y?(n). 
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The “regular falsi” method for finding the roots of f(x) = 0 is given 


by 


a(n = 1)f(æ(n)) — a(n) flan = 1) 
f(a(n)) — f(a(n — 1) l 


a(n+1)= 
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(a) Show that for f(x) = x7, this difference equation becomes 
x(n — 1)a(n) 
x(n —1) + a(n) 
(b) Let x(1) = 1,2(2) = 1 for the equation in part (a). Show that the 


solution of the equation is x(n) = 1/F (n), where F'(n) is the nth 
Fibonacci number. 


a(n+1)= 


2.7 Applications 


2.7.1 Propagation of Annual Plants 


The material of this section comes from Edelstein—Keshet [37] of plant 
propagation. Our objective here is to develop a mathematical model that 
describes the number of plants in any desired generation. It is known that 
plants produce seeds at the end of their growth season (say August), after 
which they die. Furthermore, only a fraction of these seeds survive the 
winter, and those that survive germinate at the beginning of the season 
(say May), giving rise to a new generation of plants. 
Let 

y = number of seeds produced per plant in August, 

a = fraction of one-year-old seeds that germinate in May, 

ß = fraction of two-year-old seeds that germinate in May, 


g = fraction of seeds that survive a given winter. 


If p(n) denotes the number of plants in generation n, then 


plants from plants from 
p(n) = F , 
one-year-old seeds two-year-old seeds 
p(n) = ası (n) + Bs2(n), (2.7.1) 


where s(n) (respectively, s2(n)) is the number of one-year-old (two-year- 
old) seeds in April (before germination). Observe that the number of seeds 
left after germination may be written as 


fraction original number 
seeds left = ; x A _ |. 
not germinated of seeds in April 


This gives rise to two equations: 


§1(n) = (1 — a)si(n), (2.7.2) 


52(n) = (1 — 8) s2(n), (2.7.3) 
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Year k=n Year k=n+1 Year k=n+2 


April-May August Winter April-May August Winter April-May August 


l | 
l | 
l | 
l l 
| l 
| l 
coo & s,(n+1) S,(n+1) b 
l l B 
(Nn) I e I 
| l Q J 
l Soa l 
| y ! 
l l 
I I 28 
| > g0 s(n+2) 
22 — o 
! so(n+1) i 8,(n+1) 
! a 
See 
p(n) p(n+1) p(n+2) So(n+2) 


FIGURE 2.6. Propogation of annual plants. 


where 81(n) (respectively, 52(n)) is the number of one-year (two-year-old) 
seeds left in May after some have germinated. New seeds s9(n) (0-year-old) 
are produced in August (Figure 2.6) at the rate of y per plant, 


soln) = y(n). (2.7.4) 


After winter, seeds so(m) that were new in generation n will be one year 
old in the next generation n+1, and a fraction os9(n) of them will survive. 
Hence 


si(n + 1) = oso(n), 
or, by using formula (2.7.4), we have 
sı(n +1) = oyp(n). (2.7.5) 
Similarly, 
sa(n + 1) = o5 (n), 
which yields, by formula (2.7.2), 
sa(n + 1) = a(1 — a)sı (n), 
so(n +1) = o7y(1 — a)p(n — 1). (2.7.6) 
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Substituting for sı(n + 1), s2(n + 1) in expressions (2.7.5) and (2.7.6) into 
formula (2.7.1) gives 


p(n + 1) = ayop(n) + 8yo? (1 — a)p(n — 1), 
or 
p(n + 2) = ayop(n + 1) + Byo*(1 — a)p(n). (2.7.7) 
The characteristic equation (2.7.7) is given by 
X? — ayorX — Byo?(1— a) = 0 


with characteristic roots 


og ge ei 

Ma t+ zal a; 

Aae i 1+ ae a|: 
2 ya 


Observe that A, and Az are real roots, since 1 — œ > 0. Furthermore, 
A, > 0 and Az < 0. To ensure propagation (i.e., p(n) increases indefinitely 
as n —> oo) we need to have \; > 1. We are not going to do the same with 
A2, since it is negative and leads to undesired fluctuation (oscillation) in 
the size of the plant population. Hence 


4 
wl 14% a| >t 
2 yo? 
or 
OY fa 43(1 —a) ee 
2 ya? 2 


Squaring both sides and simplifying yields 
1 
ao + Bo2(1—a) 


y> (2.7.8) 
If 8 = 0, that is, if no two-year-old seeds germinate in May, then condition 
(2.7.8) becomes 


y> ES (2.7.9) 
ao 
Condition (2.7.9) says that plant propagation occurs if the product of the 
fraction of seeds produced per plant in August, the fraction of one-year-old 
seeds that germinate in May, and the fraction of seeds that survive a given 
winter exceeds 1. 
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2.7.2 Gambler’s Ruin 


A gambler plays a sequence of games against an adversary in which the 
probability that the gambler wins $1.00 in any given game is a known 
value q, and the probability of his losing $1.00 is 1 — q, where 0 <q < 1. 
He quits gambling if he either loses all his money or reaches his goal of 
acquiring N dollars. If the gambler runs out of money first, we say that the 
gambler has been ruined. Let p(n) denote the probability that the gambler 
will be ruined if he possesses n dollars. He may be ruined in two ways. First, 
winning the next game; the probability of this event is q; then his fortune 
will be n + 1, and the probability of being ruined will become p(n + 1). 
Second, losing the next game; the probability of this event is 1 — q, and 
the probability of being ruined is p(n — 1). Hence applying the theorem of 
total probabilities, we have 


p(n) = qp(n + 1) + (1 — q)p(n — 1). 
Replacing n by n+ 1, we get 


q q 


p(n) =0, n=0,1,...,N, (2.7.10) 
with p(0) = 1 and p(N) = 0. The characteristic equation is given by 


1, 1- 
ee ei 
q q 


0, 


and the characteristic roots are given by 
1 1—2q 1-q 


AL = ; 
OG 2q q 
1 1-2 
Ny ee 
2q 2q 


Hence the general solution may be written as 
l1—q\” 1 
= — if =. 
p(n) a +ea( 7 ) ; ifa# 5 
Now using the initial conditions p(0) = 1, P(N) = 0 we obtain 
N 
Ee 
Gate =l, C1 + C2 (=) = 0, 


which gives 
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=- +4 2 (2.7.11) 


The special case q = 4 must be treated separately, since in this case we 
have repeated roots Ay = A2 = 1. This is certainly the case when we have 
a fair game. The general solution in this case may be given by 


Thus 


p(n) = a1 + azn, 
which with the initial conditions yields 


n N-n 
=1]1-—-— = 2 2.7.12 
p(n) =1- 2 = (2.7.12) 


For example, suppose you start with $4, the probability that you win a 
dollar is 0.3, and you will quit if you run out of money or have a total of 
$10. Then n = 4, q = 0.3, and N = 10, and the probability of being ruined 
is given by 


p(4) = 


On the other hand, if q = 0.5, N = $100.00, and n = 20, then from formula 
(2.7.12) we have 


Observe that if q < 0.5 and N —> oo, p(n) tends to 1 in both formulas 
(2.7.11) and (2.7.12), and the gambler’s ruin is certain. 
The probability that the gambler wins is given by 


2.7.8 National Income 


In a capitalist country the national income Y(n) in a given period n may 
be written as 


Y(n) = C(n) + I(n) + G(n), (2.7.14) 
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where 
C(n) = consumer expenditure for purchase of consumer goods, 
I(n) = induced private investment for buying capital equipment, and 


G(n) = government expenditure, 


where n is usually measured in years. 
We now make some assumptions that are widely accepted by economists 
(see, for example, Samuelson [129]). 


(a) Consumer expenditure C(n) is proportional to the national income 
Y (n — 1) in the preceding year n — 1, that is, 


C(n) = aY(n—-1), (2.7.15) 


where a > 0 is commonly called the marginal propensity to consume. 


— 
g 
SE 


Induced private investment I(n) is proportional to the increase in 
consumption C(n) — C(n — 1), that is, 


I(n) = B[C(n) — C(n — 1), (2.7.16) 


where 8 > 0 is called the relation. 


— 
lo) 
NWN 


Finally, the government expenditure G(n) is constant over the years, 
and we may choose our units such that 


G(n) =1. (2.7.17) 


Employing formulas (2.7.15), (2.7.16), and (2.7.17) in formula (2.7.14) 
produces the second-order difference equation 


Y(n+ 2) —a(1+ B)Y(n+1) + a6Y(n) =1, neZ". (2.7.18) 


Observe that this is the same equation we have already studied, in 
detail, in Example 2.38. As we have seen there, the equilibrium state 
of the national income Y* = 1/(1—a) is asymptotically stable (or just 
stable in the theory of economics) if and only if the following conditions 
hold: 


a<l, 1+a+?2aß > 0, aß <l. (2.7.19) 


Furthermore, the national income Y (n) fluctuates (oscillates) around 
the equilibrium state Y* if and only if 


46 
(1+8) 


Now consider a concrete example where a = L, b = 1. Then Y* = 2, i.e., 
Y* = twice the government expenditure. Then clearly, conditions (2.7.19) 
and (2.7.12) are satisfied. Hence the national income Y (n) always converges 
in an oscillatory fashion to Y* = 2, regardless of what the initial national 
income Y (0) and Y (1) are. (See Figure 2.7.) 


a< (2.7.20) 
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Figure 2.7 depicts the solution Y(n) if Y(0) = 1 and Y(1) = 2. Here we 
find that A = —/2 and w = 7/4 and, consequently, the solution is 


vic ee cos E + 24| +2. 


Finally, Figure 2.8 depicts the parameter diagram (3 — a), which shows 
regions of stability and regions of instability. 


2.7.4 The Transmission of Information 


Suppose that a signaling system has two signals sı and s2 such as dots and 
dashes in telegraphy. Messages are transmitted by first encoding them into 
a string, or sequence, of these two signals. Suppose that sı requires exactly 
nı units of time, and s2 exactly nə units of time, to be transmitted. Let 
M(n) be the number of possible message sequences of duration n. Now, a 
signal of duration time n either ends with an sı signal or with an sz signal. 


Real roots 
unstable 


Imaginary roots 
unstable 


Imaginary 
roots 
stable 


1 
FIGURE 2.8. Parametric diagram (8 — a). 
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—e—e——eee— .. e; M(n-n,) possible message 


—— — o$ — — ee—— __.. —; M(n-n,) possible message 


FIGURE 2.9. Two signals, one ends with sı and the other with s2. 


If the message ends with sı, the last signal must start at n — nı (since 
sı takes nı units of time). Hence there are M (n — n1) possible messages to 
which the last sı may be appended. Hence there are M (n — n1) messages 
of duration n that end with sı. By a similar argument, one may conclude 
that there are M(n — n2) messages of duration n that end with s2. (See 
Figure 2.9.) Consequently, the total number of messages x(n) of duration 
n may be given by 


M(n) = M(n— 11) + M(n — ng). 


If ny > ne, then the above equation may be written in the familiar form 
of an n,th-order equation 


M(n+m1) — M(n +n — nz) — M(n) = 0. (2.7.21) 


On the other hand, if nı < n2, then we obtain the ngth-order equation 


M(n+n2) — M(n+n2-— nı) — M(n) =0. (2.7.22) 


An interesting special case is that in which nı = 1 and ng = 2. In this case 
we have 


M(n+2) = M(n+1)+ M(n), 


which is nothing but our Fibonacci sequence {0, 1, 1,2,3,5,8,...}, which we 
encountered in Example 2.27. The general solution (see formula (2.3.14)) 
is given by 


m= a (15) -æ (155) ,  n=0,1,2,.... (2.7.23) 


2 2 


To find a, and a we need to specify M(0) and M(1). Here a sensible 
assumption is to let M(0) = 0 and M(1) = 1. Using these initial data in 
(2.7.23) yields 


and the solution of our problem now becomes 


1 f1¢v5\" iaa 
ain) = J ( ; z 5 hs (2.7.24) 
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In information theory, the capacity C of the channel is defined as 


C= log, M(n) 
noo n 


(2.7.25) 


where logs denotes the logarithm base 2. 


From (2.7.24) we have 
1+ v5 1-v5\" 
2 2 Í 
(2.7.26) 


Since ( 16 ) ~ 0.6 < 1, it follows that 1-75) +0 as n— o. 
2 2 


Observe also that the first term on the right-hand side of (2.7.26) goes 
to zero as n — Oo. 
Thus 


log : 
— 
C= tim —% 


n— o0 n 


> 1 
+ Jim = logs 


1 
C = logs ( 4) x 0.7. (2.7.27) 


Exercises 2.7 
1. The model for annual plants was given by (2.7.7) in terms of the plant 
population p(n). 
(a) Write the model in terms of sı (n). 


(b) Let a = 8 = 0.01 and o = 1. How big should y be to ensure that 
the plant population increases in size? 


2. An alternative formulation for the annual plant model is that in which 
we define the beginning of a generation as the time when seeds are 
produced. Figure 2.10 shows the new method. 


Write the difference equation in p(n) that represents this model. Then 
find conditions on y under which plant propagation occurs. 


3. A planted seed produces a flower with one seed at the end of the first 
year and a flower with two seeds at the end of two years and each year 
thereafter. Suppose that each seed is planted as soon as it is produced. 


(a) Write the difference equation that describes the number of flowers 
F(n) at the end of the nth year. 


(b) Compute the number of flowers at the end of 3, 4, and 5 years. 


4. Suppose that the probability of winning any particular bet is 0.49. 
If you start with $50 and will quit when you have $100, what is the 
probability of ruin (i.e., losing all your money): 
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(i) if you make $1 bets? 
(ii) if you make $10 bets? 
(iii) if you make $50 bets? 


. John has m chips and Robert has (N — m) chips. Suppose that John 
has a probability p of winning each game, where one chip is bet on in 
each play. If G(m) is the expected value of the number of games that 
will be played before either John or Robert is ruined: 


(a) Show that G(m) satisfies the second-order equation 
G(m + 2) + pG(m+ 1) + (1— p)G(m) = 0. (2.7.28) 
(b) What are the values of G(0) and G(N)? 


(c) Solve the difference equation (2.7.28) with the boundary condi- 
tions in part (b). 


. Suppose that in a game we have the following situation: On each play, 
the probability that you will win $2 is 0.1, the probability that you 
will win $1 is 0.3, and the probability that you will lose $1 is 0.6. 
Suppose you quit when either you are broke or when you have at least 
N dollars. Write a third-order difference equation that describes the 
probability p(n) of eventually going broke if you have n dollars. Then 
find the solution of the equation. 


. Suppose that Becky plays a roulette wheel that has 37 divisions: 18 
are red, 18 are black, and one is green. Becky can bet on either the 
red or black, and she wins a sum equal to her bet if the outcome is a 
division of that color; otherwise, she loses the bet. If the bank has one 


FIGURE 2.10. Annual plant model. 
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10. 


11. 


12. 
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million dollars and she has $5000, what is the probability that Becky 
can break the bank, assuming that she bets $100 on either red or black 
for each spin of the wheel? 


. In the national income model (2.7.14), assume that the government 


expenditure G(n) is proportional to the national income Y (n — 2) two 
periods past, i.e., G(n) = yY (n — 2), 0 < y < 1. Derive the difference 
equation for the national income Y (n). Find the conditions for stability 
and oscillations of solutions. 


. Determine the behavior (stability, oscillations) of solutions of (2.7.18) 


for the cases: 


__ 46 

@) = Gy BF 
4B 

(b) 2> TFA 


Modify the national income model such that instead of the government 
having fixed expenditures, it increases its expenditures by 5% each time 
period, that is, G(n) = (1.05)”. 


(a) Write down the second-order difference equation that describes 
this model. 


(b) Find the equilibrium value. 

(c) If a = 0.5, 8 = 1, find the general solution of the equation. 
Suppose that in the national income we make the following assump- 
tions: 

(i) Y(n) = C(n) + I(n), i.e., there is no government expenditure. 
(ii) C(n) = aY (n — 1) + a2Y (n — 2) + K, i.e., consumption in any 

period is a linear combination of the incomes of the two preceding 
periods, where a1, a2, and K are constants. 
(ii) I(n + 1) = I(n) + h, i.e., investment increases by a fixed amount 
h > 0 each period. 
(a) Write down a third-order difference equation that models the 
national income Y (n). 
1 1 
(b) Find the general solution if a, = 7702 = 7: 
(c) Show that Y (n) is asymptotic to the equilibrium Y* = a+ 8n. 

(Inventory Analysis). Let S(n) be the number of units of consumer 

goods produced for sale in period n, and let T(n) be the number of 


units of consumer goods produced for inventories in period n. Assume 
that there is a constant noninduced net investment Vo in each period. 
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Then the total income Y(n) produced in time n is given by Y(n) = 
T(n) + S(n) + Vo. 


(a) Develop a difference equation that models the total income Y (n), 
under the assumptions: 


G) S(n) = BY(n- 1), 
(ii) T(n) = BY (n — 1) — BY (n — 2). 
(b) Obtain conditions under which: 
(i) solutions converge to the equilibrium, 
(ii) solutions are oscillatory. 
(c) Interpret your results in part (b). 
13. Let I(n) denote the level of inventories at the close of period n. 


(a) Show that I(n) = I(n — 1) + S(n) + T(n) — GY(n) where 
S(n), T(n), Y(n) are as in Problem 12. 


(b) Assuming that S(n) = 0 (passive inventory adjustment), show 
that 


I(n) — I(n—1) = (1-B)¥(n) -Vo 
where Vo is as in Problem 12. 
(c) Suppose as in part (b) that s(n) = 0. Show that 
I(n+ 2) — (84+ 1)L(n+1)+ BI(n) =0. 
(d) With 6 4 1, show that 


Hn) = (10) - -25) or + 
where (E — @)I(n) = c. 


14. Consider (2.7.21) with nı = ng = 2 (i.e., both signals sı and sz take 
two units of time for transmission). 


(a) Solve the obtained difference equation with the initial conditions 
M(2) = M(3) =2. 


(b) Find the channel capacity c. 


15. Consider (2.7.21) with nı = n2 = 1 (i.e., both signals take one unit of 
time for transmission). 


(a) Solve the obtained difference equation. 


(b) Find the channel capacity c. 
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(Euler’s method for solving a second-order differential equation.) Re- 
call from Section 1.4.1 that one may approximate 2’(t) by (a(n + 
1) — x(n))/h, where h is the step size of the approximation and 
x(n) = «(to + nh). 

(a) Show that 2”(t) may be approximated by 

x(n +2) — 2z(n + 1) + a(n) 
h? ` 
(b) Write down the corresponding difference equation of the differen- 
tial equation 


x” (t) = f (e(t), z'(t)). 
Use Euler’s method described in Problem 16 to write the corresponding 
difference equation of 


x(t) —4a(t) =0, x(0)=0, x'(0)=1. 


Solve both differential and difference equations and compare the 
results. 


(The Midpoint Method). The midpoint method stipulates that one 
may approximate 2’(t) by (x(n +1) — z(n — 1))/h, where h is the step 
size of the approximation and t = tg + nh. 

(a) Use the method to write the corresponding difference equation of 
the differential equation 2’(t) = g(t, x(t)). 

(b) Use the method to write the corresponding difference equation of 
x(t) = 0.7x? + 0.7, 2(0) = 1,t € [0,1]. Then solve the obtained 
difference equation. 

(c) Compare your findings in part (b) with the results in Section 1.4.1. 


Determine which of the two methods, Euler or midpoint, is more 
accurate. 


3 


Systems of Linear Difference Equations 


In the last chapter we concerned ourselves with linear difference equations, 
namely, those equations with only one independent and one dependent 
variable. Since not every situation that we will encounter will be this simple, 
we must be prepared to deal with systems of more than one dependent 
variable. 

Thus, in this chapter we deal with those equations of two or more depen- 
dent variables known as first-order difference equations. These equations 
naturally apply to various fields of scientific endeavor, like biology (the 
study of competitive species in population dynamics), physics (the study 
of the motions of interacting bodies), the study of control systems, neurol- 
ogy, and electricity. Furthermore, we will also transform those high-order 
linear difference equations that we investigated in Chapter 2 into systems 
of first-order equations. This transformation will probably prove to be of 
little practical use in the realm of boundary value problems and oscilla- 
tions, but will be substantiated as an immensely helpful tool in the study 
f stability theory later on, see [3], [79], [87]. 


° 


3.1 Autonomous (Time-Invariant) Systems 


In this section we are interested in finding solutions of the following system 
of k linear equations: 


xy(n + 1) = angi (n) + agron) +--+ + akzk(n), 


Lo(n + 1) = axx (n) + azz (n) +--+ + agkzk(N), 
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zpen + 1) = agi ai(n) + akoza(n) +--+ + akkzk(n). 
This system may be written in the vector form 
x(n +1) = Az(n), (3.1.1) 


where a(n) = (21(n), r2(n),...,ax(n))? € R*, and A = (aij) isa k xk 
real nonsingular matrix. Here T indicates the transpose of a vector. Sys- 
tem (3.1.1) is considered autonomous, or time-invariant, since the values 
of A are all constants. Nonautonomous, or time-variant, systems will be 
considered later in Section 3.3. 

If for some no > 0,x(no) = xo is specified, then system (3.1.1) is called 
an initial value problem. Furthermore, by simple iteration (or by direct 
substitution into the equation), one may show that the solution is given by 


x(n,no, xo) = A”? xo, (3.1.2) 


where A? = I, the k x k identity matrix. Notice that x(no, no, zo) = zo. If 
no = 0, then the solution in formula (3.1.2) may be written as x(n, xo), or 
simply x(n). We now show that we may assume that no = 0 without loss 
of generality. 

Let y(n — no) = x(n). Then (3.1.1) becomes 


y(n + 1) = Ay(n), (3.1.3) 
with y(0) = z(no) and 
y(n) = A”y(0). (3.1.4) 
A parallel theory exists for systems of linear differential equations. The 
solution of the initial value problem 


=, = Ar(t), x(to) = £0, 


where A is a k x k matrix, x € R*, is given by 


a(t) = efto) ro. 


3.1.1 The Discrete Analogue of the Putzer Algorithm 


In differential equations the Putzer algorithm is used to compute e“*. Here, 
we introduce an analogous algorithm to compute A”. First, let us review 
the rudiments of matrix theory that are vital in the development of this 
algorithm. In what follows C denotes the set of complex numbers. 

Recall that for a real k x k matrix A = (aij), an eigenvalue of A is a 
real or complex number À such that AE = AE for some nonzero £ € C*. 
Equivalently, this relation may be written as 


(A- ADE =0. (3.1.5) 
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Equation (3.1.5) has a nonzero solution if and only if 
det(A — AI) = 0, 
or 
DAS tig ee ae ee = O. (3.1.6) 


Equation (3.1.6) is called the characteristic equation of A, whose roots À 
are called the eigenvalues of A. If Ay,A2,.--,Ax are the eigenvalues of A 
(some of them may be repeated), then one may write (3.1.6) as 


k 


pA) = [J -A). (3.1.7) 


j=l 


We are now ready to state the Cayley-Hamilton theorem, one of the 
fundamental results of matrix theory. 


Theorem 3.1. Every matrix satisfies its characteristic equation. That is, 


k 
p(A) = | [(A-AjD) = 0, (3.1.8) 
j=l 
or 
AP + ay AFT! + ap AP? +--+ + at =0. (3.1.9) 


3.1.2 The Development of the Algorithm for A” 


Let A be a k x k real matrix. We look for a representation of A” in the 
form 


AN = X y(n) MŲ - 1), (3.1.10) 


where the u,;(n)’s are scalar functions to be determined later, and 
M(j) =(A-A;DM(Uj-1), M(0) =T, (3.1.11) 
or 
MG +1)=(A-AjDM(), M0) =I. 
By iteration, one may show that 
MONA DU eal oo Aaah, 
or, in compact form, 


M(n) = [a-n (3.1.12) 


j=1 
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Notice that by the Cayley-Hamilton theorem we have 


j=l 
Consequently, M(n) = oot all n > k. In light of this observation, we may 
rewrite formula (3.1.10) as 
k 
A” =X u;(n)M(j — 1). (3.1.13) 
j=l 


If we let n = 0 in formula (3.1.13) we obtain 
A? = I =u, (0)I + u2(0)M (1) +--+ + ug(0)M(k — 1). (3.1.14) 
Equation (3.1.14) is satisfied if 


ui(0)=1 and u2(0) = u3(0) =--- = uz(0) = 0. (3.1.15) 


From formula (3.1.13) we have 
k k 
X uj(n + 1I)M(j-1) = AA" =A |X w(n)M( - 1) 
= a 


k 
=A a n)AM(j—1). 
Substituting for AM (j — 1) from (3.1.11) yields 
k 
ts (n+ 1)M(j -1) -Euo j) +Aà;M(j—1)]. (3.1.16) 


Comparing the coefficients of M(j),1 < j < k, in (3.1.16), and applying 
condition (3.1.15), we obtain 

uiln + 1) = àui (n), ui(0) = 1 

uj(n +1) =Aju;(n) + uj-ı(n), uj (0) = 0, j= 2,3,...,k. (3.1.17) 


The solutions of (3.1.17) are given by 


n-1 


u(n) =A} wln) = Se ujali), j =2,3,...,k. (3.1.18) 
1=0 


Equations (3.1.12) and (3.1.18) together constitute an algorithm for com- 
puting A”, which henceforth will be called the Putzer algorithm. For more 
details and other algorithms, the interested reader may consult the paper 
by Elaydi and Harris [46]. 


3.1 Autonomous (Time-Invariant) Systems 121 


Example 3.2. Find A” if 


Solution The eigenvalues of A are obtained by solving the characteristic 
equation 


-À 1 1 
det(A — AI) = det | -2 3-A 1 |=0. 
= oe AAA 


Hence 


p(A) = à’ — 7A? + 16\ — 12 
= (A — 2}? (A-3) = 0. 


The eigenvalues of A are Ay = A» = 2, A3 = 3, 


—2 1 1 
—3 1 2 
—1 0 1 
M(2) =(A-21), M(1)=(A-2N?=[-1 0 1 
—2 0 2 
Now 
u(n) = 4”, 
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At = Y/uj(n) MG — 1) 


gn-l TE 3r = n2r-1 n2r-l omy 3r 
= gn Aa 3n = n2r-t (n as 227% gn aif 3n 
APE as PE Rk n2"! 2” 4.9.3" 


Example 3.3. Find the solution of the difference system a(n + 1) = 
Ax(n), where 


4 1 2 
A=|]0 2 —4 
0 1 6 


Solution The eigenvalues of A may be obtained by solving the characteristic 
equation det(A — AI) = 0. Now, 


4—r 1 2 
dt| 0 2-rXA —4 | =(4-A)(A-4)? =0. 
0 1 6-2 


Hence, the eigenvalues of A are Ay = Az = A3 = 4. So 


M(0)=I, M(1)=A- veel , 
0 
0 
0 


a G 
os © 


Now 


u(n) = 4”, 

ua(n) = So (41) (44) = na"), 
i=0 

u3(n) = 5 wea * 


i=0 
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Using (3.1.13), we have 


1 0 0 0 1 2 
A” =4°|0 1 O] +n4™ "10 -2 -4 
001 0 1 2 
00 0 
pO 00 0 
00 0 
4” n4”! 2n4”7t 
=| 0 4” —2n4™! —n4” 
0 n4”! 4” Opa) 


The solution of the difference equation is given by 
4” x1 (0) + n4"~*ao(0) + 2n4"~1x3(0) 
x(n) = A”x(0) = (4? — 2n4"~1)a9(0) — n4” z3 (0) ; 
nA”—xo(0) + (4” + 2n4"—") 23 (0) 
where x(0) = (a1(0), v2(0), x3(0))T. 


Exercises 3.1 


In Problems 1 through 4, use the discrete Putzer algorithm to evaluate A”. 


1 1 
1. A= i 
—2 4 
-1 2 
2, A= . 
3 0 
1 2 1 
3. A= |0 1 0 
4 -4 5 
2 1 0 
4,.A=]0 2 1 
0 0 2 


5. Solve the system 
zın +1) = =x (n) + x(n), x1(0) = 1, 
xt2(n + 1) = 2z2(n), x2(0) = 2. 

6. Solve the system 
zın +1) = xo(n), 
t2(n + 1) = z3(n), 
x3(n + 1) = 2a) (n) — za(n) + #3(n). 
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10. 


11. 


12. 
13. 
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Solve the system 


1 -2 -2 1 
z(n+1)= |0 0 -1} a(n), x(0) = 
0 2 3 0 
. Solve the system 
1 3 0 0 
0 2 1 -1 
1)= ; 
e a a 
000 3 
2 -1 : ! Tr 
. Verify that the matrix A = i 3 satisfies its characteristic 


equation (the Cayley Hamilton Theorem). 


Let p(A) = max{|A| : A is an eigenvalue of A}. Suppose that p(A) = 
po < P. 
(a) Show that |u;(n)| < aS a ak: 
(8 — po) 
(b) Show that if pọ < 1, then u;(n) — 0 as n > oo. Conclude that 
A” > 0 as n > œ. 


(c) If a < min{|A| : A is an eigenvalue of A}, establish a lower bound 
for |u;(n)|. 


Ifa k x k matrix A has distinct eigenvalues 1, A2,.-., Ax, then one 
may compute A”,n > k, using the following method. Let p(A) be 
the characteristic polynomial of A. Divide A” by p(A) to obtain A” = 
p(A)q(A) +1r)(A), where the remainder r(A) is a polynomial of degree 
at most (k — 1). Thus one may write A” = p(A)q(A) + r(A). 


(a) Show that A” = r(A) = aol + a1 A + ag A? +--+ + ap-1 A71. 
(b) Show that AP = r(à1), AZ = r(A2),..., AB = rk): 


(c) Use part (b) to find ao, a1,..., @x—1. 
Extend the method of Problem 11 to the case of repeated roots. 
Apply the method of Problem 12 to find A” for: 


1 4 
(i) A= e i 
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(0,1) 


AlN. 
Po Pa (1,0) 


FIGURE 3.1. 


14. Apply the method of Problem 12 to find A” for 


4 1 2 
A=ļ|0 2 —4 
0 1 6 


15.1 Consider the right triangle in Figure 3.1 where p(0) = (0,0), p(1) = 
(4,4), and p(2) = (4,0). For p(n) = (a(n), y(n)) with n > 3, we have 


x(n +3) = (a(n) + (n + 1)), 


y(n +3) = 5(y(n) + y(n + 1). 
(a) Write each equation as a system z(n +1) = Az(n). 
(b) Find limpo p(n). 


3.2 The Basic Theory 


Now contemplate the system 
x(n + 1) = A(n)a(n), (3.2.1) 


where A(n) = (aij(n)) is a k x k nonsingular matrix function. This is 
a homogeneous linear difference system that is nonautonomous, or time- 
variant. 

The corresponding nonhomogeneous system is given by 


y(n + 1) = A(n)y(n) + g(n), (3.2.2) 


where g(n) € RE. 
We now establish the existence and uniqueness of solutions of (3.2.1). 


‘Proposed by C.V. Eynden and solved by Trinity University Problem Solving 
Group (1994). 
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Theorem 3.4. For each zo € R! and no € Zt there exists a unique 
solution x(n, no, zo) of (3.2.1) with x(no, no, zo) = zo. 
PROOF. From (3.2.1), 
z(no + 1, no, £o) = A(no)x(no) = A(no)xo, 
x(no + 2, no, zo) = A(no + 1)æ(no + 1) = A(no + 1)A(no)zxo. 


Inductively, one may conclude that 


n-1 
x(n, no, £o) = Il A(i)| xo, (3.2.3) 
where 
act A(n —1)A(n — 2) --- A(no) ifn > no, 
I] 40 = 
i=no I if n = no. 


Formula (3.2.3) gives the unique solution with the desired properties. 


We will now develop the notion of a fundamental matrix, a central 
building block in the theory of linear systems. 


Definition 3.5. The solutions zı(n), z2(n),..., x(n) of (3.2.1) are said 
to be linearly independent for n > no > 0 if whenever c,x1(n) + czx(n) + 
-+-+ cpa,(n) = 0 for all n > no, then ci = 0,1 <i<k. 


Let (n) be a k x k matrix whose columns are solutions of (3.2.1). We 
write 


(n) = [x1 (n), ro(n),..., 2% (n)]. 


Now, 
®(n +1) = [A(n)zı (n), A(n)xe(n),..., A(n) xz (n)] 
= A(n)[x1(n), za(n),...,£p(n)] 
= A(n)®(n). 
Hence, ®(n) satisfies the matrix difference equation 
P(n +1) = A(n)®(n). (3.2.4) 
Furthermore, the solutions 71(n),22(n),...,%%(n) are linearly indepen- 


dent for n > no if and only if the matrix ®(n) is nonsingular (det ®(n) # 0) 
for all n > no. (Why?) This actually leads to the next definition. 


Definition 3.6. If ®(n) is a matrix that is nonsingular for all n > no 
and satisfies (3.2.4), then it is said to be a fundamental matrix for system 
equation (3.2.1). 


Note that if ®(n) is a fundamental matrix and C is any nonsingular 
matrix, then ®(n)C is also a fundamental matrix (Exercises 3.2, Problem 
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6). Thus there are infinitely many fundamental matrices for a given system. 
However, there is one fundamental matrix that we already know, namely, 


(n) = Ul A(t), with ®(no) = I 


i=no 


(Exercises 3.2, Problem 5). In the autonomous case when A is a constant 
matrix, ®(n) = A”7™, and if no = 0, then ®(n) = A”. Consequently, it 
would be much more suitable to use the Putzer algorithm to compute the 
fundamental matrix for an autonomous system. 


Theorem 3.7. There is a unique solution U(n) of the matrix (3.2.4) with 


PROOF. One may think of the matrix difference equation (3.2.4) as a 
system of k? first-order difference equations. Thus, to complete the point, 
we may apply the “existence and uniqueness” Theorem 3.4 to obtain a k?- 
vector solution v such that v(no) = (1,0,...,1,0,...)", where 1’s appear at 
the first, (k+ 2)th, (2k +3)th, ... slots and 0’s everywhere else. The vector 
v is then converted to the k x k matrix U(n) by grouping the components 
into sets of k elements in which each set will be a column. Clearly, U(n9) = 
I. 


We may add here that starting with any fundamental matrix ®(n), the 
fundamental matrix (n)! (no) is such a matrix. This special fundamen- 
tal matrix is denoted by ®(n, no) and is referred to as the state transition 
matrix. 

One may, in general, write P(n, m) = ©(n)®~1(m) for any two posi- 
tive integers n,m with n > m. The fundamental matrix ®(n,m) has some 
agreeable properties that we ought to list here. Observe first that ®(n,m) 
is a solution of the matrix difference equation ®(n + 1,m) = A(n)®(n, m) 
(Exercises 3.2, Problem 2). The reader is asked to prove the following 
statements: 


(i) ®-!(n,m) = (m,n) (Exercises 3.2, Problem 3). 
(ii) O(n, m) = ®(n,r)®(r,m) (Exercises 3.2, Problem 3). 
(iii) (n,m) =], Ali) (Exercises 3.2, Problem 3). 


Corollary 3.8. The unique solution of x(n,no,2o) of (3.2.1) with 
x(n, no, Xo) = £o is given by 


x(n, no, zo) = O(n, No) Lo. (3.2.5) 


Checking the linear independence of a fundamental matrix 6(n) for n > 
no is a formidable task. We will instead show that it suffices to establish 
linear independence at no. 
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Lemma 3.9 Abel’s Formula. For any n > no > 0, 


n—1 


det ®(n) = (i [det 7) det (no). (3.2.6) 


i= 


PROOF. Taking the determinant of both sides of (3.2.4) we obtain the 
scalar difference equation 


det ®(n + 1) = det A(n) det &(n) 


whose solution is given by (3.2.6). 


Corollary 3.10. Jf in (3.2.1) A is a constant matrix, then 


det B(n) = [det AJ"-"° det B(no). (3.2.7) 


PROOF. The proof follows from formula (3.2.6). 


Corollary 3.11. The fundamental matriz P(n) is nonsingular for alln > 
no if and only if ®(ng) is nonsingular. 


ProoF. This follows from formula (3.2.6), having noted that det A(i) 40 
for i > nọ. 


Corollary 3.12. The solutions xı(n), xzə(n),...,£p(n) of (3.2.1) are 
linearly independent for n > no if and only if (no) is nonsingular. 


ProoFr. This follows immediately from Corollary 3.11. 


The following theorem establishes the existence of k linearly independent 
solutions of (3.2.1). 


Theorem 3.13. There are k linearly independent solutions of system 
(3.2.1) for n > no. 


PROOF. For each i = 1,2,..., k, let e; = (0,0,..., 1,..., 0)” be the 
standard unit vector in R} where all the components are zero except the 
ith component, which is equal to 1. By Theorem 3.4, for each e;, 1 <i < k, 
there exists a solution x(n, no, ei) of (3.2.1) with x(no, no, ei) = ei. To prove 
that the set {x(n, no, e;)|1 < i < k} is linearly independent, according to 
Corollary 3.11 it suffices to show that ®(no) is nonsingular. But this fact is 
obvious, since ®(no) = I. The proof of the theorem is now complete. 


Linearity Principle. An important feature of the solutions of system 
(3.2.1) is that they are closed under addition and scalar multiplication. 
That is to say, if xı(n) and x(n) are solutions of (3.2.1) and c € R, then: 


(1) x(n) + x2(n) is a solution of (3.2.1), 
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(2) ca (n) is a solution of (3.2.1). 
This is called the linearity principle. 


PROOF. Statement (1) can be proved as follows. Let x(n) = zı (n)+z2(n). 
Then 


a(n+1)=a1(n4+1)4+ x(n + 1) 
= Ar,(n) + Axa(n) 
= Aļzı (n) + x2(n)] 


= Ar(n). 


The proof of (2) is similar. 


An immediate consequence of the linearity principle is that if xı (n), xo(n), 
...,2%(n) are also solutions of system (3.2.1), then so is any linear 
combination of the form 

x(n) = c121(n) + c2za(n) +--+ ckzgln). 

This leads to the following definition. 

Definition 3.14. Assuming that {x;(n)|1 < i < k} is any linearly inde- 


pendent set of solutions of (3.2.1), the general solution of (3.2.1) is defined 
to be 


k 
a(n) = 2 ciziln), (3.2.8) 


where c; € R and at least one c; 4 0. 
Formula (3.2.8) may be written as 
x(n) = &(n)c, (3.2.9) 


where ®(n) = (a(n), v2(n),...,2%(n)) is a fundamental matrix, and c = 
(c1,¢2,...,¢%)7 € RE. 


Remark: The set S of all solutions of system (3.2.1) forms a linear 
(vector) space under addition and scalar multiplication. Its basis is any 
fundamental set of solutions and hence its dimension is k. The basis 
{xi(n), v2(n),...,2%(7)} spans all solutions of equation (3.2.1). Hence any 
solution x(n) of equation (3.2.1) can be written in the form (3.2.8) or 
equivalently (3.2.9). This is why we call x(n) in (3.2.8) a general solution. 


Let us now focus our attention on the nonhomogeneous system (3.2.2). 
We define a particular solution yp(n) of (3.2.2) as any k-vector function 
that satisfies the nonhomogeneous difference system. The following result 
gives us a mechanism to find the general solution of system (3.2.2). 
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Theorem 3.15. Any solution y(n) of (3.2.2) can be written as 
y(n) = O(n)c+ yp(n) (3.2.10) 


for an appropriate choice of the constant vector c, and a particular solution 
Y(n). 
PROOF. Let y(n) be a solution of (3.2.2) and let yp(n) be any particular 
solution of (3.2.2). If s(n) = y(n) — yp(n), then 
e(n +1) = y(n +1) — y(n + 1) 

= A(n)y(n) — A(n)yp(n) 

= A(n)[y(n) — yp(n) 

= A(n)x(n). 


Thus x(n) is a solution of the homogeneous equation (3.2.1). Hence x(n) = 
®(n)c for some vector constant c. Thus 


y(n) = Yp(n) = O(nje 


which proves (3.2.10). 


We now give a formula to evaluate y,(n). 


Lemma 3.16. A particular solution of (3.2.2) may be given by 


n-1 


y(n) = >) &(n,r + Lg(r) 


r=no 


Yp(n +1) = 5 @(n+1,r+ 1)g(r) 


= A(n)yp(n) + g(n). 


Hence, yp(n) is a solution of (3.2.2). Furthermore, yp(no) = 0. 


Theorem 3.17 (Variation of Constants Formula). The unique 
solution of the initial value problem 


y(n +1) = A(n)y(n) + g(r), y(no) = vos (3.2.11) 
is given by 
y(n, no, yo) = (n, no)yo + Sa (n,r +1)g(r), (3.2.12) 
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or, more explicitly, by 


y(n, no, Yo) = (i ao) Yo + 5 ( Ul ao) g(r). (3.2.13) 


i=no r=no \i=r+1 


Proor. This theorem follows immediately from Theorem 3.15 and 
Lemma 3.16. 


Corollary 3.18. For autonomous systems when A is a constant matriz, 
the solution of (3.2.11) is given by 


n-1 


y(n, no, yo) = A" yo + X` AMT" g(r). (3.2.14) 


Tr=Nno 


Example 3.19. Solve the system y(n + 1) = Ay(n) + g(n), where 


2 1 n 1 
k ) , s(n) (") , y(0) (o) 
Solution Using the Putzer algorithm, one may show that 
ae 7 le 
A = : 
0 2° 


Hence, 


> Ta (n=r— Y (o) 
n—r—1 
Ó 0 2 1 


nol ~ + (n= r — 1)2”7"7? 
n—r—1 
r=0 2 
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1 


n— 1 


II 


Qn 
jer? 


b-G) J-#( 


ie 
1-(5) 


II 
ETON ea aN 
o N 
3 
Ss 
+ 
N 
3 


= A i a `n 
g a 

Pen oa nae? n 

7 2” -1 


e 


)] 


We now revisit scalar equations of order k and demonstrate how to trans- 
form them into a k-dimensional system of first-order equations. Consider 


again the equation 


y(n + k) + pi(n)y(n + k= 1) +- + pe(n)y(n) = g(n). 


This relation may be written as a system of first-order equations of 


dimension k. We let 


Zk 


Let z(n) = (21(n), z2(n),... 


Hence, 


zi(n st 


2z2(n 4 


zk-1ı(n + 


(n) = y(n), 
(n) = y(n + 1) 
(n) =yln-+2 
(n) = y(n4 
, Zk(n)). 
1 zə(n), 
+ 1) = z3(n), 
1) = zk(n), 


zk(n + 


n H1), 


Hk- 1) = z_1(n+1). 


1) = =p (n)z1 (n) — pe-i(m)z2(n),.-. 


— pı(n)zk(n) + g(n). 
In vector notation, we transcribe this system as 


z(n + 1) = A(n)z(n) + h(n), 


9 


(3.2.15) 


(3.2.16) 
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where 
0 1 0 0 
0 0 1 0 
0 0 0 see 0 
A(n) = f , , (3.2.17) 
0 0 0 1 
—p(n) —ppk-ı(n) —pr—2(n) —pı (n) 
and 
h(n) = 
g(n) 


If g(n) = 0, we arrive at the homogeneous system 
z(n +1) = A(n)z(n). (3.2.18) 


The matrix A(n) is called the companion matriz of (3.2.15). 
Consider now the kth-order homogeneous equation with constant 
coefficients 


s(n + k) + piz(n+ k-— 1) +pr(n+k-— 2) +: +ppx(n)=0, (3.2.19) 


which is equivalent to the system where A is the companion matrix defined 
in formula (3.2.17) with all p;’s constant, 


z(n +1) = Az(n). (3.2.20) 


We first observe that the Casoratian of (3.2.19) is denoted by C(n) = 
det ®(n), where ®(n) is a fundamental matrix of (3.2.20). (Why?) (Ex- 
ercises 3.2, Problem 14.) The characteristic equation of A is given 
by 


AE 4 py APO + poA? +--+ pp_1A +p, =0 (Exercises 3.2, Problem 13), 


which correlates with (2.3.2). Hence, the eigenvalues of A are the roots of 
the characteristic equation of (2.3.1). 


Exercises 3.2 


1. Let @,(n) and (n) be two fundamental matrices of system (3.2.1). 
Prove that ®ı(n)®T (no) = &2(n)&z'(ng) for any no > 0. 
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10. 


11. 


12. 
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. Let ®(n,m) be a fundamental matrix of (3.2.1). Show that: 


(i) ®(n,m) is a solution of ®(n + 1,m) = A(n)®(n,m). 
(ii) (n,m) is a solution of P(n, m + 1) = (n, m) ATH (m). 


. Let P(n, m) be a fundamental matrix of (3.2.1). Show that: 


(a) ®(n,m) = A”—™ if A(n) = A is a constant matrix. 
(b) ®(n,m) = O(n, r)®(r,m). 

(c) O(n, m) = (m,n). 

(a) (n,m) = TT, AC). 


i=m 


. Let (n) be a fundamental matrix of (3.2.1). Show that each column 


of ®(n) is a solution of (3.2.1). 


t=n 


. Show that ®(n) = Min, A(i) is a fundamental matrix of (3.2.1). 
. Show that if ®(n) is a fundamental matrix of (3.2.1) and C is any 


nonsingular matrix, then ®(n)C is also a fundamental matrix of 
(3.2.1). 


. Show that if ®|(n),®2(n) are two fundamental matrices of (3.2.1), 


then there exists a nonsingular matrix C such that ®2(n) = ®)(n)C. 


. Solve the system: 


y(n q 1) = y2(n), 
yo(n + 1) = ys(n) + 2, 
y3(n + 1) = y(n) + 2y3(n) + n?, 


. Solve the system: 


yi(n + 1) = 2y1(n) + 3y2(n) + 1, 
yo(n +1) = y(n) + 4y2(1), 
yi(0) = 0, y2(0) = —1. 


Solve the system y(n + 1) = Ay(n) + g(n) if 


2 2 -2 
A=ļ|0 3 1 |, g(n) = 
0 1 8 n? 


For system equation (3.2.18) show that 
det A(n) = (—1)* pz (n). 
If ®(n) is a fundamental matrix of (3.2.18), prove that 


det ®(n) = (—1)F"™—”0) (i ni) det ®(ng). 


1=No 
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13. Prove by induction that the characteristic equation of 


0 1 0 na 0 
0 0 1 0 
A= 
0 0 0 1 
—Pk —Pk-1 —Pk-2 Pl 


AF + pa AFTI + poA? + +++ + ppd + pp = O. 


14. Let W (n) be the Casoratian of (3.2.15) with g(n) = 0. Prove that 
there exists a fundamental matrix ®(n) of (3.2.18) such that W(n) = 
det ®(n). 


Use the methods of systems to solve the difference equation for Problems 
15 through 19. 


15. x(n + 2) + 8a(n +1) + 122(n) =0. 
16. x(n +2) — 16a(n) =0. 

17. y(n +2) — 5y(n +1) + 4y(n) = 4”. 
18. A?y(n) = 16. 

19. A?a(n) + Aa(n) — x(n) = 0. 


3.3 The Jordan Form: Autonomous 
(Time-Invariant) Systems Revisited 


The Jordan form of a matrix is vital for both theoretical and computational 
purposes in autonomous systems. In this section we will briefly describe the 
Jordan form and derive a new method for computing fundamental matrices. 


3.3.1 Diagonalizable Matrices 


We say that the two k x k matrices A and B are similar if there exists a 
nonsingular matrix P such that P~'AP = B. It may be shown in this case 
that A and B have the same eigenvalues and, in fact, the eager student 
will prove this supposition in Exercises 3.3, Problem 15. If a matrix A is 
similar to a diagonal matrix D = diag(Aj,2,...,Ax), then A is said to 
be diagonalizable. Notice here that the diagonal elements of D, namely, 
1, A2,- --, Ag, are the eigenvalues of A. We remark here that only special 
types of matrices are diagonalizable. For those particular diagonalizable 
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matrices, computing A” is simple. For if 
PAP = D = diag i A2,- .- , Ak], 
then 
A= PDP H, 
and, consequently, 
A” = (PDP) = PD” P™!. 
Explicitly, 


A” =P Po. (3.3.1) 


0 N? 


If we are interested in finding another (but simpler) fundamental matrix of 
the equation 


z(n +1) = Az(n), (3.3.2) 
then we let 
M 0 
A2 
(n) = A"P =P : (3.3.3) 
0 Ag 


From formula (3.3.3) we have ®(0) = P and, consequently, 
A” = (n)! (0). (3.3.4) 


Now, formula (3.3.3) is useful only if one can pinpoint the matrix P. 
Fortunately, this is an easy task. We will now reveal how to compute P. 

Let P = (£1, £2,- . , Ek), where €; is the ith column of P. Since P~! AP = 
D, then AP = PD. This implies that Aĉ; = A;€;,i = 1,2,...,k (Exercises 
3.3, Problem 15). Thus, &;,1 <i < k, is the eigenvector of A corresponding 
to the eigenvalue à;, and hence the ith column of P is the eigenvector 
of A corresponding to the ith eigenvalue à; of A. Since P is nonsingular, 
its columns (and hence the eigenvectors £1, &,...,€ of A) are linearly 
independent. Reversing the above steps, one may show that the converse 
of the above statement is true. Namely, if there are k linearly independent 
eigenvectors of a k x k matrix A, then it is diagonalizable. The following 
theorem summarizes the above discussion. 


Theorem 3.20. A k x k matrix is diagonalizable if and only if it has k 
linearly independent eigenvectors. 
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Let us revert back to formula (3.3.3), which gives us a computational 
method to find a fundamental matrix (n). Let Ay, A2,..., Ax be the eigen- 
values of A and let £1, &2,...,&€ be the corresponding linearly independent 
eigenvectors of A. Then from formula (3.3.3) we have 


AT 0 
ry 
(n) = [Eis Eztena Ek] l 
0 ar 
= [ATE1, AZ E2, --- ABER]. (3.3.5) 


Notice that since columns of ®(n) are solutions of (3.3.2), it follows that 
for each 1,1 <i < k, a(n) = APE is a solution of (3.3.2). 
Hence, the general solution of (3.3.2) may be given by 


a(n) = CAPE, + CARE +e + RARER. (3.3.6) 
The following example illustrates the above method. 


Example 3.21. Find the general solution of x(n + 1) = Ax(n), where 


Solution The eigenvalues of A may be obtained by solving the 
characteristic equation 
2— À 2 1 
det(A — AT) = det 1 3-A 1 =0. 
1 2 2—A 
This determinant produces (A — 1)?(A—5) = 0. Thus, A, = 5, and Az = 


A3 = 1. To find the corresponding eigenvectors, we solve the equation 
(A — \I)x = 0. Hence, for Ay = 5, 


= 
| 
N 
= 
8 
X 
II 
=e ae = ae a) 


Solving this system gives us the first eigenvector 


f&= {1 
1 
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For A2 = A3 = 1, we have 


1 2 1\ Fay 0 
12 1) /a]=|0 
1 2 1) \as 0 


Consequently, x, + 2£2 + 23 = 0 is the only equation obtained from this 
algebraic system. To solve the system, two of the three unknown terms 
%1,2%2,and x3 must be arbitrarily chosen. So if we let x; = 1 and z2 = 0, 


then z3 = —1, and we obtain the eigenvector 
1 
f&=| 0 
—1 


On the other hand, if we let zı = 0 and z2 = 1, then z3 = —2, and we 
obtain the third eigenvector 


&3 = 
25 


Obviously, there are infinitely many choices for £2, 3. Using formula (3.3.6), 
we see that the general solution is 


1 1 0 
a(n)=c15" | 1] +e] 0 J+es] 1f, 
1 —1 —2 
or 
c15” + C2 
x(n) = c15” + c3 (3.3.7) 


c15” =p 2c3 


Suppose that in the above problem we are given an initial value 


and must find the solution x(n) with this initial value. One way of doing this 
is by letting n = 0 in the solution given by formula (3.3.7) and evaluating 
the constants c1,c2, and c3. 

Thus 


Cy T C2 = 0, 


Cy + C3 = 1, 


Cy — Cg — 2c3 = Q. 
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Solving this system gives cı = Z, C2 = -t, and c3 = Z, leading us to the 
solution 
1 1 
~ 
x(n) = - + 2 
3° 3 


We now introduce yet another method to find the solution. Let 


x(n) = &(n)®~*(0)x(0), 


where 
(n) = (ATE1, A3 E2, AZE3) 
5” 1 0 
=15" 0 1 
5” —1 -2 
and 
1 0 
o(0)=]1 0 1 
1 -1l -2 
Thus, 
1 1 1 
4 2 4 
6-1(0) = 3 1 1 
4 2 4 
1 1 1 
4 2 4 
This gives 
1 1 1 
5” 1 0 4 2 4 0 
a(n)=] 5" 0 3 ae E 1 
4 2 4 
5” —1 —2 1 1 1 0 
42 4 
1 1 
Spa S 
2 2 
1 1 
= SRR paa 
2 Ta 
1 1 
Spia 
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In the next example we will examine the case where the matrix A has 
complex eigenvalues. Notice that if A is a real matrix (which we are assum- 
ing here) and if A = a+ i is an eigenvalue of A, then À = a — iG is also 
an eigenvalue of A. Moreover, if € is the eigenvector of A corresponding to 
the eigenvalue À = a + iG, then € is the eigenvector of A corresponding 
to the eigenvalue \ = a — i. Taking advantage of these observations, one 
may be able to simplify considerably the computation involved in finding 
a fundamental matrix of the system of equations (3.3.2). 

Suppose that € = +7. A solution of system (3.3.2) may then be given 


by x(n) = (a + iB)" (€1 + i£2). Also, if 


PENETER, 


0 = tan”! (£) . 
a 


This solution may now be written as 


then 


x(n) = [rcos 6 + isin 0)]” (1 + i£2) 
=r"(cosné + isin n0) (£1 + 7&2) 
=r"|(cos n0)& — (sin nO)£9] + ir™[(cos nO)€ + (sin nA) E41] 
=u(n) +7 v(n), 
where u(n) = r”[(cosn@)& — (sinn@)&] and v(n) = r™[(cosné)€ + 
(sin n@)&1]. One might show (Exercises 3.3, Problem 7) that u(n) and v(n) 


are linearly independent solutions of system (3.3.2). Hence, we do not need 
to consider the solution generated by A and £. 


Example 3.22. Find a general solution of the system z(n + 1) = Az(n), 


where 
1 —5 
fe ( | 
1 —1 


Solution The eigenvalues of A are A; = 2i, A2 = —2i, and the corresponding 
eigenvectors are 


Hence, 
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is a solution. Since 
: T aragi T 
i = cos — + isin — 
2 2. 


in nT i . NT 
i” = cos — + isin — 
2 3 


this solution may be written as 


1 2. 
a(n) = 2” (cos (>) + isin (5) 5 5 


1 
1 NT 2. nT 
258 5 05 ( 2 ) + 5sm 2 
NT 
es (7) 
= cos (77) t E sin (27) 
+i | 5 2 ae 2 
Ta 
Thus, 
cos (22) { Z sin (2) 
unar | BELT BN 
oo (2) 
and 


—2 NT 1. snr 
v(n) = 2” a ee) 
sin (+) 
are two linearly independent solutions. A general solution may be given as 
1 NT 2. (nt 
a(n) = a2” 5 005 ( 2 ) | = sin ( 2 ) 


cos (>) 
2 


So far, we have discussed the solution of system (3.3.2) if the matrix A is 
diagonalizable. We remark here that a sufficient condition for a kx k matrix 
A to be diagonalizable is that it have k distinct eigenvalues (Exercises 3.3, 
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Problem 20). If the matrix A has repeated roots, then it is diagonalizable if 
it is normal, that is to say, if AT A = AA’. (For a proof see [111].) Examples 
of normal matrices are: 

(i) symmetric matrices (AT = A), 

(ii) skew symmetric matrices (A? = —A), 


(iii) unitary matrices (ATA = AAT = T). 


3.3.2 The Jordan Form 


We now turn our attention to the general case where the matrix A is not 
diagonalizable. This happens when A has repeated eigenvalues, and one is 
not able to generate k linearly independent eigenvectors. For example, the 
following matrices are not diagonalizable: 


A e CO © 


oma) 
aco 
oO bf! 
oN Oo 
Ne o 
oOo m Wf 
Go OW CO 
O Aà CO D 


Ifa k x k matrix A is not diagonalizable, then it is akin to the so-called 
Jordan form, i.e., PLAP = J, where 


J = diag(J1, Jo,...,Jr), 1l<r<k, (3.3.8) 
and 
A 1 0 
0 ài 
Ji = She (3.3.9) 
0 0 en o 
: : : 1 
0 0 ri 


The matrix J; is called a Jordan block. 
These remarks are formalized in the following theorem. 


Theorem 3.23 (The Jordan Canonical Form). Any kx k matrix A 
is similar to a Jordan form given by the formula (3.3.8), where each J; is 
an si x 8; matriz of the form (3.3.9), and Y`; si = k. 


The number of Jordan blocks corresponding to one eigenvalue A is called 
the geometric multiplicity of A, and this number, in turn, equals the number 
of linearly independent eigenvectors corresponding to A. 
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The algebraic multiplicity of an eigenvalue A is the number of times it 
is repeated. If the algebraic multiplicity of A is 1 (i.e., A is not repeated), 
then we refer to A as simple. If the geometric multiplicity of A is equal to 
its algebraic multiplicity (i.e., only 1 x 1 Jordan blocks correspond to A), 
then it is called semisimple. For example, the matrix 


E ee) 
Dn es >) 
Go ON CO oO 
oOo Oo Oo 
oe Oo So © 


has one simple eigenvalue 3, one semisimple eigenvalue 2, and one 
eigenvalue 5, which is neither simple nor semisimple. 

To illustrate the theorem, we list below the possible Jordan forms of a 
3 x 3 matrix with an eigenvalue À = 5, of multiplicity 3. In the matrix, 
different Jordan blocks are indicated by squares. 


510 0 5 11/0 510 0 5 1 0 
01510 0 50 015 1 0 5 1 
0 015 0 05 0/10 5 0 0 5 


Recall that s; is the order of the ith Jordan block and r is the number of 
Jordan blocks in a Jordan form. In (a) the matrix is diagonalizable, and 
we have three Jordan blocks of order 1. Thus, sı = s9 = s3 = 1,r = 3, and 
the geometric multiplicity of A is 3. 

In (b) there are two Jordan blocks with sı = 2,s2 = 1,r = 2, and the 
geometric multiplicity of A is 2. 

In (c) there are also two Jordan blocks with sı = 1, sg = 2,r = 2, and 
the geometric multiplicity of A is 2. In (d) there is only one Jordan block 
with sı = 3,r = 1, and the geometric multiplicity of A is 1. The linearly 
independent eigenvectors corresponding to A = 5 in (a), (b), (c), (d) are, 
respectively, 


1 0 0 1 0 1 0 
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Note that a matrix of the form 


A 1 0 
0 A 1 
000... 1 
000... AÀ 
has only one eigenvector, namely, the unit vector e1 = (1,0,...,0)7. This 


shows us that the linearly independent eigenvectors of the Jordan form J 
given by formula (3.3.8) are 
E1, 5,415 €sit+sotls +++ 1 Csi s24: +5sr-1+1' 
Now, since P~'AP = J, then 
AP=PJ. (3.3.10) 


Let P = (&1,62,...,€). Equating the first sı columns of both sides in 
formula (3.3.10), we obtain 


AE, = A1G),.--, AG = ALG; + &i-1, C= 28h esi ST (3.3.11) 


Clearly, é is the only eigenvector of A in the Jordan chain £1, &,...,&s,. 
The other vectors £,&3,...,&s, are called generalized eigenvectors of A, 
and they may be obtained by using the difference equation 


(A= ADE; =h T= 2,3,...,51. (3.3.12) 


Repeating this process for the remainder of the Jordan blocks, one may 
find the generalized eigenvectors corresponding to the mth Jordan block 
using the difference equation 


(A = AmI )Em; = Em; -1, EEEE OE (3.3.13) 
Now we know that A” = (PJP~!)" = PJ” P-t, where 
Jt 0 
Jy 
J” = 
0 Jk 
Notice that for any J; i = 1,2,...,r, we have J; = A; + N;, where 
010.. 0 
0 0 1 0 
N; = 


0 0 wes 0 
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is an s; X s; nilpotent matrix (i.e., N? = 0 for all r > s;). Hence, 
n 
1 


JP = (AI + Ni)" = API + ( ALTIN; 


T (;) ALT? N? Pasi ( os CN 
2 Si — 1 
y? n ae n ee D n anait 
1 2 Si — 1 
n n n—1 n n—s;+ 
1 Si — 2 


pi 


N 


0 0 y x 
(3.3.14) 


The lines inside J} indicate that the entries in each diagonal are identical. 
We can now substantiate that the general solution of system (3.3.2) is 


a(n) = A”c = PJ” P*e, 
or 
x(n) = PJ”ê, (3.3.15) 
where 


ê= Pote. 


II 


Hence, a fundamental matrix of system (3.3.2) may be given by ®(n) 
PJ”. Also, the state transition matrix may be given by ®(n,no) = 
PJ"—"0 P-t and thus 2(n, no, xo) = PJ"—™ P—12. 

The following corollary arises directly from an immediate consequence 
of formula (3.3.14). 


Corollary 3.24. Assuming that A is any kx k matriz, then limn+. A” = 
0 if and only if |A| < 1 for all eigenvalues À of A. 


PROOF. (Exercises 3.3, Problem 21.) 


The importance of the preceding corollary lies in the fact that if 
limps A” = 0, then limp...” = limn A”x(0) = 0. This fact re- 
minds us that if |A| < 1 for all eigenvalues of A, then all solutions x(n) of 
(3.3.1) tend toward the zero vector as n — oo. 
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Example 3.25. Find the general solution of x(n + 1) = Az(n) with 


4 1 2 
A=|]0 2 —4 
0 1 6 


Solution Note that this example uses conclusions from Example 3.3. The 
eigenvalues are Ay = Ao = A3 = 4. To find the eigenvectors, we solve the 
equation (A — AT)€ = 0, or 


0 1 2 dy 0 
0 -2 —4 da | = | 0 
0 1 2 d3 0 
Hence, 
dz + 2d = 0, 
—2dz — 4d3 = 0, 
dz + 2d3 = 0. 
These equations imply that dz = —2d3, thus generating two eigenvectors, 
0 1 
&= | -2 and &) = | —2 
1 1 


We must now find one generalized eigenvector 3. Applying formula 
(3.3.11), let us test (A — 41)&3 = &: 


0 1 2 ay 0 
0 -2 —4 a2 = —2 
0 1 2 a3 1 


This system is an inconsistent system that has no solution. The second 
attempt will use 


(A — 41)& = £2, 
or 
0 1 2 ay 1 
0 -—2 —4 a2 | = | —2 
0 1 2 a3 1 


Hence, a2 + 2a3 = 1. One may now set 
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Thus, 
0 1 0 
P= |]-2 -2 -1], 
1 1 1 
4 0 0 
J=|0 4 1], 
0 0 4 
and 
4” 0 0 
J»=| 0 4” n4t 
0 0 4” 
Hence, 
0 4” n4”! ĉ1 
a(n) = PJ°@= | —2.4” —2.4” —2n4"! —4"” | | ĉ 
—4” gr nar} 44” és 
Example 3.26. Solve the system 
1 
a(n+1)=Aza(n), x(0)=] 1], 
1 
where 
3/2 1/2 1/2 
A= |1/2 5/2 -1/2 
0 1 2 
Solution The eigenvalues of A are à} = Ay = A3 = 2. We have a sole 
eigenvector, 
1 
& = | 0 
1 


We now need to compose two generalized eigenvectors, using (3.3.13): 


1 
(A = 21) = ĉi gives £3 = 1 
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and 
1 
(A — 21)€3 = &2 gives £3 = | 2 
1 
So 
1 1 1 2 1 0 
P=10 1 2], J=]0 2 1], 
1 2 1 0 0 2 
gn no-i -I)on 
-fi gn e 
0 0 2 
Now, 
x(n, zo) = PJ” P~! zo 
n? —5n +16 n? +3n —n? + 5n 1 
= 4n 4n + 16 —4n 1 
n? -n n? +T7n —n?+n+16 1 
n? +3n +16 
=2"4| 4n+16 
n? +7n +16 


3.3.9? Block-Diagonal Matrices 
In general, the generalized eigenvectors corresponding to an eigenvalue A 
of algebraic multiplicity m are the solutions of the equation 

(A-—AD™E =0. (3.3.16) 

The first eigenvector é corresponding to À is obtained by solving the 

equation 

(A -— ADE =0. 
The second eigenvector or generalized eigenvector z is obtained by solving 
the equation 

(A—A1)7é=0. 


And so on. 

Now if J is the Jordan form of A, that is, PAP = J or A= PJP}, 
then åA is an eigenvalue of A if and only if it is an eigenvalue of J. Moreover, 
if € is an eigenvector of A, then E = P~'€ is an eigenvector of J. 
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We would like to know the structure of the eigenvectors ra of J. For this 
we appeal to the following simple lemma from Linear Algebra. 


A 0 
Lemma 3.27. Let C = { be a k x k block-diagonal matrix such 


that A is anr xr matriz and B is an s x s matriz, with r+ s = k. Then 
the following statements hold true: 


(i) If A is an eigenvalue of A, then it is an eigenvalue of C. Moreover, the 
eigenvector and the generalized eigenvectors corresponding to À are of 
the form £ = (a1, a2,...,a7,0,...,0)? for some a; E€ R. 


(ii) If A is an eigenvalue of B, then it is an eigenvalue of C. Moreover, the 
eigenvector and the generalized eigenvectors corresponding to À are of 
the form € = (0,...,0, @r41, @r42,---,Gs) for some arpi E R. 


PROOF. 


(i) Suppose that A is an eigenvalue of A, and V = (a1,a2,..., ap)? is 
the corresponding eigenvector. Define € = (a1,...,a,,0,...,0) € RF. 
Then clearly CE = A£, and thus A is an eigenvalue of C. Let the k x k 


I, 0 


identity matrix I be written in the form I = , where I, and 


S 
I, are, respectively, the r x r and s x s identity matrices. Let À be an 
eigenvalue of A with algebraic multiplicity m. Then 


‘I 0 
(C -ANE = oa i ) gelo 
0 B — \Is 
fs 0 
Hence 
I 0 
(4-My) |] =|: 
&r 0 
has a nontrivial solution 
ay 


mm 
II 


ar 
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However 

Er+1 0 

B-j] : |= 
Es 0 

has only the trivial solution 

0 

0 
Then € = (a1,...,a,,0,...,0)” is an eigenvector of C corresponding 


to A. The same analysis can be done for generalized eigenvectors by 
solving (C — AIYE =0,1<i< m. 


(ii) The proof of the second part is analogous and will be omitted. 


Exercises 3.3 


In Problems 1 through 6, use formula (3.3.6) to find the solution of x(n + 
1) = Ax(n), where A is given in the exercise. 


Haslet oe oft 
E ed a OY 


1 0 
2 a=( i: 
1 2 
2 3 0 0 
3. A=ļ4 3 0], 2(0)= [1 
00 6 0 
2 —1 0 
4,.A=]0 4 ol. 
2 5 3 
1 0 1 
5. A=|1 2 3]. 
00 3 
1 1.0 1 
6 A={-1 1 0],  2(0)=]0 
1 0 1 1 


3.3 


10. 


11. 
12. 


13. 
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. Suppose that x(n) = u(n) + iv(n) is a solution of (3.3.2), where 


u(n) and v(n) are real vectors. Prove that u(n) and v(n) are linearly 
independent solutions of (3.3.2). 


. Utilize Problem 7 to find a fundamental matrix of x(n + 1) = Ax(n) 


with 
1 1 0 1 
-1 1 0 1 
A = 
0 0 2 1 
0 0 -1 2 
. Apply Problem 7 to find a fundamental matrix of a(n + 1) = Az(n) 
with 
1 1 0 
A=|-1 1 0 
1 0 1 


Find the eigenvalues and the corresponding eigenvectors and general- 
ized eigenvectors for the matrix A. 


') 2 1 0 
(a) A= 2 VAS ore 1 
002 


poe 2000 
1 0210 
(c) a ae W 0021 
0 0 3 0002 


Find A” for the matrices in Problem 10 using the Jordan form. 


Use the Jordan form to solve x(n + 1) = Ax(n) with 


3 2 1 
A=|-1 3 2 
1 -3 -2 


Use the Jordan form to solve x(n + 1) = Ax(n) with 
3 2 3 
A=[|-12 1 0 
0 02 
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14. 


15. 


16. 


17. 
18. 


19. 


20. 


21. 
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Let A and B be two similar matrices with P~'AP = B. 
(i) Show that A and B have the same eigenvalues. 


(ii) Show that if € is an eigenvector of B, then PE is an eigenvector 
of A. 


Suppose that P~-1AP = D = diag(A1,A2,..-,Ax), where P = 


(£1, £2, . . . , Ek] is a nonsingular k x k matrix. Show that £1, £2, . . . , Ek are 
the eigenvectors of A that correspond to the eigenvalues A1, À2,..., Àk, 
respectively. 


Let A be a 4 x 4 matrix with an eigenvalue \ = 3 of multiplicity 4. 
Write all possible Jordan forms of A. 


Show that (PJP71)® = PJP P-L. 


If À is an eigenvalue of A, and € is the corresponding eigenvector of A, 
show that A” is a solution of (3.3.2). 


Let 
1 0 
0 xX 0 
00... 1 
0 0... A 
Then one may write A = A I + N, where 
01... 0 
a 0 0 
nas 1 
0 0 0 
Show that for any a > 0, A is similar to a matrix 
A a... 0 
0 A 
B=AXI4+aN= 
T a 
0 0 A 


Prove that if a k x k matrix A has k distinct eigenvalues, then: 
(i) A has k linearly independent eigenvectors. 
(ii) A is diagonalizable. (Use mathematical induction.) 


Prove Corollary 3.24. 
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22. Consider the companion matrix A of (3.2.17) with the coefficients p; 
constant. Assume that the eigenvalues of A are real and distinct. Let 
V denote the Vandermonde matrix 


1 1 1 
` M Ne 
V= 
AET ee. bas Dees 


Show that V~!AV is a diagonal matrix. 


23. Consider the companion matrix A (3.3.16) with p;(n) constants. Sup- 
pose 1, A2,.--,Ar are the distinct eigenvalues of A with multiplicities 
m1,M2,...,m, and X; Mmi = k. Let V be the generalized Vander- 
monde matrix (2.3.9). Show that V-1AV = J, where J is in the Jordan 
form (3.3.8). 


3.4 Linear Periodic Systems 


In this section we regard the linear periodic system 
z(n+1) = A(n)ax(n), (3.4.1) 


where for all n € Z, A(x + N) = A(x), for some positive integer N. 

We now show that the study of the periodic system (3.4.1) simplifies 
to the study of an associated autonomous system. This inference is the 
analogue of Floquet theory in differential equations. But before we prove 
that analogue, we need the following theorem. 


Lemma 3.28. Let B beak x k nonsingular matrix and let m be any 
positive integer. Then there exists some kx k matriz C such that C™ = B. 


PROOF. Let 


be the Jordan form of B. Let us write 


1 
J,= A (u+ Ni], 
( i Ài ) 
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where J; is the s; x s; identity matrix and 


0 1 0 
0 1 
N; = 
1 
0 0 
Observe that 
N =0. (3.4.2) 


To motivate our construction, we formally write 


1 
H; = exp [tn s: 


= exp È fm Aili + ln (1 + <M) \ 
joti AS 
-eli faan SU Y: 
Applying formula (3.4.2), we obtain 


m=op [2 fa ans $C oo (Ayy, (3.4.3) 


ri 


Hence, H; is a well-defined matrix. Furthermore, H? = J;. 


Now, if we let 
Hı 0 
Hə 


0 H, 
where H; is defined in formula (3.4.3), then 
Ay" 
H” = . = J. 
0 H?” 
Define C = PHP +, Then C™ = PAP = PJP! = B. 


Armed with this lemma, we are now prepared to introduce the primary 
result for this section. 
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Lemma 3.29. For system (3.4.1), the following statements hold: 
(i) If ®(n) is a fundamental matrix, then so is P(n + N). 

(ii) O(n + N) = ®(n)C, for some nonsingular matrix C. 

(iii) (n+ N,N) = ®(n,0). 


PROOF. 

(i) Let ®(n) be a fundamental matrix of system (3.4.1). Then ®(n+1) = 
A(n)®(n). Now 

@®(n+N+1) = A(n+ N)O(n+ N) 
= A(n)®(n + N) 
Hence ®(n + N) is also a fundamental matrix of system (3.4.1). 

(ii) Observe that Y(n, no) = O(n + N)®~!(no + N) and Wo2(n,no) = 
®(n)@~1(ng) are fundamental matrices of system (3.4.1) with the 
same initial condition Ẹ:(no, no) = V2(no,no) = I. By the unique- 
ness of fundamental matrices (Theorem 3.7) Y(n, no) = W2(n, no). 
This implies that 

P(n + N) = P(n) (np) ®(no + N) 
= 8(n)C 
(iii) This is left to the reader as Problem 1. 


There are many consequences of this lemma, including the following 
theorem. 


Theorem 3.30. For every fundamental matriz ®(n) of system (3.4.1), 
there exists a nonsingular periodic matriz P(n) of period N such that 


B(n) = P(n)B". (3.4.4) 


PROOF. By Lemma 3.28, there exists some matrix B such that BN = C, 
where C is the matrix specifed in Lemma 3.29(ii). Define P(n) = ®(n)B~”, 
where B-” = (B”)~1. Then 


P(n+ N) = (n+ N)B NB” 
n)CB-N B~ [using part (ii) of Lemma 3.29] 


We now know that P(n) has period N and is clearly nonsingular. (Why?) 
From the definition of P(n) it thus follows that ®(n) = P(n) B”. 


Remark: If z(n) is a solution of the system 


z(n+1) = Bz(n), (3.4.5) 
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then 


or 
x(n) = P(n)z(n). (3.4.6) 


The value of this remark lies in the fact that the qualitative study of the 
periodic system of equations (3.4.1) reduces to the study of the autonomous 
system (3.4.5). 

The matrix C = B”, which may be found using Lemma 3.29 part (ii), is 
referred to as a monodromy matrix of (3.4.1). The eigenvalues of B are 
called the Floquet exponents of (3.4.1); the corresponding eigenvalues AN 
of BN are called the Floquet multipliers of (3.4.1). The reason we call AN a 
multiplier is that there exists a solution x(n) of (3.4.1) such that x(n+N) = 
AN x(n). (See Exercises 3.4, Problem 9.) Notice that the Floquet exponents 
(multipliers) do not depend upon the monodromy matrix chosen, that is, 
they do not hinge upon the particular fundamental matrix ®(n) used to 
define the monodromy matrix. The following lemma explicitly states this 
truth. 


Lemma 3.31. Jf ®(n) and Y(n) are two fundamental matrices of (3.4.1) 
such that 


(n+ N) = B®(n)C, 
(n+ N) = Y(n)E, 


then C and E are similar (and thus they have the same eigenvalues). 


Proor. The reader will prove this lemma in Exercises 3.4, Problem 
2. 


Lemma 3.32. A complex number A is a Floquet exponent of (3.4.1) if 
and only if there is a nontrivial solution of (3.4.1) of the form X"q(n), 
where q(n) is a vector function with q(n + N) = q(n) for alln. 


ProoF. First, we assume that A is a Floquet exponent of (3.4.1). Then, 
we also know that det(B” — A” T) = 0. Now choose zo € RF, £o 4 0, such 
that (B” — A” I)xo = 0 for all n. (Why?) (See Exercises 3.4, Problem 4.) 
Hence, we have the equation B” xp = A" xo. 

Thus, P(n)B" xp = à” P(n)xo, where P(n) is the periodic matrix defined 
in formula (3.4.4). By formula (3.4.4) now, 


x(n, no, Yo) = P(n, no)zo = P(n)B” zo = A" P(n)xo = A G(n), 


and we have the desired periodic solution of (3.4.1), where q(n) = P(n)xo. 
Conversely, if X”q(n), (n+ N) = q(n) # 0 is a solution of (3.4.1), Theorem 
3.30 then implies that 


A" g(n) = P(n)B” xo (3.4.7) 
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for some nonzero vector £o. This implies that 
AN a(n) = P(n) BT zo. (3.4.8) 
But, from (3.4.7), 
AN a(n) = AN P(n) B” zo. (3.4.9) 
Equating the right-hand sides of formulas (3.4.8) and (3.4.9), we obtain 
P(n)B" [BN — A^ I]zo = 0, 
and thus 


det[BY — AI] = 0. 


This manipulation shows that A is a Floquet exponent of (3.4.1). 


Using the preceding theorem, one may easily conclude the following 
results. 


Corollary 3.33. The following statements hold: 


(i) System (3.4.1) has a periodic solution of period N if and only if it has 
a Floquet multiplier equal to 1. 


(ii) There is a Floquet multiplier equal to —1 if and only if system (3.4.1) 
has a periodic solution of period 2N. 


PROOF. Use Lemma 3.32 as you prove Corollary 3.33 in Exercises 3.4, 
Problem 3. 


Remark: Lemma 3.29, part (ii), gives us a formula to find the monodromy 
matrix C = BN, whose eigenvalues happen to be the Floquet multipliers 
of (3.4.1). From Lemma 3.29, 


C= 671(n)®(n +N). 
By letting n = 0, we have 
C = 671(0)®(N). (3.4.10) 


If we take ®(N) = A(N—1)A(N—2)---A(O), then ®(0) = I. Thus, formula 
(3.4.10) becomes 


C=8(N), 
or 
C = A(N —1)A(N — 2) -- - A(0). (3.4.11) 


We now give an example to illustrate the above results. 
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Example 3.34. Consider the planar system 
x(n +1) = A(n)x(n), 


Clearly, A(n + 2) = A(n) for all n € Z. 
Applying formula (3.4.10), 


: -1 0 
BY = C = A(1)A(0) = : 
0 -1 
Thus the Floquet multipliers are —1, —1. By virtue of Corollary 3.33, the 
system has a 4-periodic solution. Note that since A(n) has the constant 
eigenvalues —1, 1, p(A(n)) = 1. 


The above example may suggest that there is some kind of relationship 
between the eigenvalues of A(n) and its Floquet multipliers. To dispel any 
such thoughts we offer the following example. 


Example 3.35. Consider system (3.2.1) with 


2+4(-1)" 
A(n) = i 2 
~ | 2-(-1)" 
tess 0 


This is a system of period 2. The eigenvalues of A are +, and hence 
p(A) = ¥3 < 1. Now, 


B? = C = A(1)A(0) = 


© #8lR 
AIS © 


Thus, the Floquet multipliers are + and 2. Hence, p(B) = 3. 


Exercises 3.4 
1. Prove Lemma 3.29 (iii). 
2. Prove Lemma 3.31. 
3. Prove Corollary 3.33. 
4 


. Suppose that (B — AI)ro = 0 for some x € RF, xo Æ 0. Prove that 
(B® — X” I)zo = 0 for all n € Zt. 


5. Let ai(n),a2(n) be N-periodic functions and let Y(n), Ya(n) be 
solutions of 


x(n + 2) + a(n)z(n + 1) + az(n)x(n) = 0 (3.4.12) 
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such that (0) = 1, ¥,(1) = 0, ¥2(0) = 0, and W2(1) = 1. Show that 
the Floquet multipliers satisfy the equation A? + bA + c = 0, where 


b=-[Wi(N)+W2(N+1)], c= II ao(i). 


6. In Problem 5, let a2(n) = 1. Show that the product of the Floquet 
multipliers is equal to 1. 


7. In Problem 5, let ag(n) = 1. Show that if b = 2, there is at least one 
solution of period 2N while for b = —2 there is at least one solution of 
period N. 


8. In Problem 5 it is clear that if A = 1, then (3.4.12) has a periodic 
solution of period N. Show that 2(n+2)+a1(n)¢(n+1)+a2(n)z(n) = 0 
has a periodic solution of period 2N if and only if A = —1. 


9. Show that there exists a solution x(n) of (3.4.1) that satisfies 
x(n + N) = rzx(n) if and only if A is a Floquet multiplier. 


3.5 Applications 


3.5.1 Markov Chains 


In 1906 the Russian mathematician A.A. Markov developed the concept 
of Markov chains. We can describe a Markov chain as follows: Suppose 
that we conduct some experiment with a set of k outcomes, or states, 
S = {s1,82,..., Sk}. The experiment is repeated such that the probability 
(pij) of the state s;,1 < i < k, occurring on the (n+1)th repetition depends 
only on the state s; occurring on the nth repetition of the experiment. In 
other words, the system has no memory: The future state depends only 
on the present state. In probability theory language, pi; = p(s;|s;) is the 
probability of s; occurring on the next repetition, given that s; occurred 
on the last repetition. Given that s; has occurred in the last repetition, one 
of s1, S2,..., Sk must occur in the next repetition. Thus, 


Pij + poy + psj ++: + prj = 1, I1<j <k. (3.5.1) 


Let p;(n) denote the probability that the state s; will occur on the nth 
repetition of the experiment, 1 < i < k. Since one of the states s; must 
occur on the nth repetition, it follows that 


pi(n) + pa(n) +--+ + pk(n)=1. (3.5.2) 


To derive a mathematical model of this experiment, we must define p;(n+ 
1),1 < i < k, as the probability that the state s; occurs on the (n + 1)th 
repetition of the experiment. There are k ways that this can happen. The 
first case is where repetition n gives us sı, and repetition (n + 1) produces 
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si. Since the probability of getting sı on the nth repetition is pı(n), and 
the probability of having s; after sı is p;1, it follows (by the multiplication 
principle) that the probability of the first case occurring is pj1pi(n). The 
second case is where we get s2 on repetition n and s; on repetition (n+ 1). 
The probability of the occurrence of the second case is pj2p2(n). Repeating 


this for cases 3,4,...,k, and fori = 1,2,...,k, we obtain the k-dimensional 
system 

pi(n + 1) = prpi(m) + pi2pe(n) +--+ + pirpe(n), 

p2(n + 1) = papi (n) + p22p2(n) +--+ + porpr(n), 

pk(n + 1) = perpi(n) + peope(n) + +++ + Peepe(n), 


or, in vector notation, 
p(n+1) = Sp(n), WH 12.3054 (3.5.3) 


where p(n) = (pi(n),p2(n),...,pe(n))" is the probability vector and S = 
(pij) isa k x k transition matriz. 

The matrix S belongs to a special class of matrices called Markov matri- 
ces. A matrix A = (aij) is said to be nonnegative (positive) if aj; > 0 (> 0) 
for all entries aj; of A. A nonnegative k x k matrix A is said to be Markov 
(or stochastic) if wy aij = 1 for all j = 1,2,...,k. It follows from Ta- 
ble 4.1 that || Al], = 1, which by inequality (4.1.3) implies that p(A) < 1. 
Hence |A| < 1 for all the eigenvalues \ of a Markov matrix. Furthermore, 
= 1 is an eigenvalue of a Markov matrix (Exercises 3.5, Problem 3). 
Hence p(A) = 1 if A is Markov. 


3.5.2 Regular Markov Chains 


A regular Markov chain is one in which S”™ is positive for some positive 
integer m. To give a complete analysis of the eigenvalues of such matrices, 
we need the following theorem, due to O. Perron. 


Theorem 3.36 (Perron’s Theorem). Let A be a positive kx k matriz. 
Then p(A) is a simple real eigenvalue (not repeated) of A. If A is any other 
eigenvalue of A, then |A| < p(A). Moreover, an eigenvector associated with 
p(A) may be assumed to be positive. 


Suppose now that S is the transition matrix of a regular Markov chain 
with eigenvalues 1, A2,..., Ag. Then p(S) = 1. If S™ is positive, then 
p(S™) = 1. As a matter of fact, the eigenvalues of 9™ are Aj’, Ad’, ..., AR. 
By Perron’s theorem, 1 is a simple eigenvalue of S’™. Consequently, S has 
exactly one simple eigenvalue, say Àq, which equals 1; all other eigenvalues 
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satisfy |A;| < 1,7 = 2,3,...,k. Hence, the Jordan form of S must be of the 
1 0 
form J = ae E where the eigenvalues of J, are A2, A3,..-,Ak- 
By Corollary 3.24, J? — 0 as n > oo, so that J” — diag(1,0,...,0) as 
n — oo. Therefore, if S = QJQ7!, we have 


lim p(n) = lim S”p(0) = lim QJ”Q7'p(0) = (€1,0,0,...,0)7 = aĉ, 
noo noo n—> oo 
(3.5.4) 
where €; = (£11, €21,...,€k1)" is the eigenvector of S that corresponds to 
the eigenvalue A, = 1, and a is the first component of n = Q~'p(0). Since 


finding the matrix Q is not a simple task, we will choose instead to devise 
a very easy method to find the constant a. Recall that for 


p(n) = (pi(n),p2(n),---,pe(m))” 


we have, from formula (3.5.2), Ei piln) = 1. Since limpo p(n) = a&i, 
it follows that 


ay, + ao, +--+ + akı = 1. 


Therefore, 


1 
O éu téa t t Ek 


a 


The following example illustrates a regular Markov chain. 


Example 3.37. The simplest type of genetic inheritance of traits in ani- 
mals occurs when a certain trait is determined by a specific pair of genes, 
each of which may be of two types, say G and g. An individual may have 
a GG combination, a Gg (which is genetically the same as gG), or a gg 
combination. An individual with GG genes is said to be dominant; a gg 
individual is referred to as recessive; a hybrid has Gg genes. 

In the mating of two animals, the offspring inherits one gene of the pair 
from each parent: The basic assumption of genetics is that the selection of 
these genes is random. 

Let us consider a process of continued matings. We begin with an individ- 
ual of known genetic character (GG) and mate it with a hybrid. Assuming 
that there is one offspring, we mate that offspring with a hybrid, repeating 
this process through a number of generations. In each generation there are 
three possible states, sı = GG, s2 = Gg, and s3 = gg. Let p;(n) represent 
the probability that state s; occurs in the nth generation and let pij be the 
probability that s; occurs in the (n+1)th generation given that sj occurred 
in the nth generation. 
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The difference system that models this Markov chain is denoted by 
pi(n + 1) = ppi (n) + pi2p2(n) + pisps(n), 


p2(n +1) = poipi(n) + pr2p2(n) + p23p3(n), 
p3(n + 1) = psipi(n) + ps2pe(n) + p33p3(n). 


Now, pi1 is the probability of producing an offspring GG by mating GG 
and Gg. Clearly, the offspring receives a G gene from his parent GG with 
probability 1 and the other G from his parent Gg with probability 4. By 


the multiplication principle, pj; = 1 x 4 = 5. The probability of creating 
an offspring GG from mating a Gg with a Gg is pio. By similar analysis 
one may show that piz = ł x $ = L, Likewise, pı3 is the probability of 


generating an offspring GG from mating a gg with a Gg. Obviously, pi3 = 0. 
One may show by the same process that 


1 il ol -o 1 il 
9? p22 = = 9? P31 = U, P32 = 7’ P33 = z: 


Hence, we have 


P21 = 


p(n +1) = Spln) 


with 
0.5 0.25 0 
S=105 05 0.5 
0 0.25 0.5 


Notice that all the entries for S$? are positive, and thus this is a regular 
Markov chain. The eigenvalues of S are A; = 1,A2 = , and à3 = 0. Recall 
from formula (3.5.4) that 


lim p(n) = ay. 


noo 
Now, 
1 
f&=|2 
1 
and 
1 
eee 
4 
implies that 
0.25 
Jim, p(n) = | 0.5 
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This relation dictates that as the number of repetitions approaches infin- 
ity, the probability of producing a purely dominant or a purely recessive 
offspring is 0.25, and the probability of creating a hybrid offspring is 0.5. 


38.5.8 Absorbing Markov Chains 


A state s; in a Markov chain is said to be absorbing if whenever it occurs 
on the nth repetition of the experiment, it then occurs on every subsequent 
repetition. In other words, if for some i, py = 1, then pi; = 0 for j Ai. A 
Markov chain is said to be absorbing if it has at least one absorbing state 
and if from every state it is possible to go to an absorbing state. In an 
absorbing Markov chain, a state that is not absorbing is called transient. 


Example 3.38. Drunkard’s Walk 


A man walks along a four-block stretch. He starts at corner x. With prob- 
ability Z he walks one block to the right, and with probability 4 he walks 
one block to the left. When he comes to the next corner he again randomly 
chooses his direction. He continues until he reaches corner 5, which is a bar, 
or corner 1, which is his home. (See Figure 3.2.) If he reaches either home 
or the bar, he stays there. This is clearly an absorbing Markov chain. 

Let us rename the states so that the absorbing states at 1 and 5 are last, 
and so we refer to them as s4 and s5. The transient states 2, 3, and 4 will 
be called s1, s2, and s3, respectively. Accordingly, pı (n), po(n), pa (n), pa(n), 
and ps(n) will be, respectively, the probabilities of reaching 1, s2, $3, $4, 
and s5 after n walks. The difference equation that represents this Markov 
chain is p(n + 1) = S'p(n), where the transition matrix is 


1 
ap ies 
po 0 o0 
geil oo BE ele Be 
ue sae hep: Q I 
1 
Te 1 0 
0 0 5 0 1 
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u(n + 1) = Tu(n), (3.5.5) 
vu(n +1) = v(n) + Qu(n). (3.5.6) 
Therefore, 
u(n) = T”u(0). (3.5.7) 
Substituting from formula (3.5.7) into formula (3.5.6) yields 
vu(n + 1) = v(n) + QT” u(0). (3.5.8) 


By formula (3.2.14), it follows that the solution of (3.5.8) is given by 


vu(n) = v(0) + 3 QT”u(0). (3.5.9) 
r=0 


1 1 
=f 

Hence, by Corollary 3.24, limp. T” = 0. In this case one may show that 

0° n—1 

T” = lim X T"=(I- T)! 

> im 2 GeT) 

(Exercises 3.5, Problem 5). Using formula (3.5.9), we generate 
Jim, v(n) = v(0) + QU — T)~*u(0). 


The eigenvalues of T are 


Now, 
3 1 
en ae 
2 2 
G=" sI 2 1 
1 
EE 
2 2 
1 1 
on. 2 2 Ù 
i, {VN , [Home 
S; S2 S; S, S; 
4 4 4 4 + 
Š; S, S, S; S; 


FIGURE 3.2. Drunkard’s walk. 
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Assume that the man starts midway between home and the bar, that is, 
at state so. Then 


Ke © 


© 


and 


In this case 


1 Er 1 

= 0 Dale 2\ (9 Es 
lim v(n) = | 2 A eee a ea by 
noo 

PRA WJA A 


Thus, the probability that the man ends up at his home is 0.5. The proba- 
bility that he ends up at the bar is also 0.5. Common sense could probably 
have told us this in the first place, but not every situation will be this 
simple. 


3.5.4 A Trade Model 


Example 3.39. Consider a model of the trade between two countries, 
restricted by the following assumptions: 


i) National income = consumption outlays + net investment + exports 
— imports. 


(ii) Domestic consumption outlays = total consumption — imports. 

(iii) Time is divided into periods of equal length, denoted by n = 0,1,2,.... 

Let, for country j = 1,2, 

y;(n) = national income in period n, 

n) = total consumption in period n, 
) 
) 
) 


m,(n) = imports in period n, 
d 


cj( 
i;(n) = net investment in period n, 
x;(n) = exports in period n, 
( 
(n) = consumption of domestic products in period n. 


For country 1 we then have 


y(n) = a(n) + i(n) + zı (n) — m(n), 
di(n) = c1(n) — m(n), 
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which, combining those two equations, gives 


y(n) = dy(n) + zı (n) + i(n). (3.5.10) 
Likewise, for country 2, we have 
y2(n) = do(n) + x2(n) + iz(n). (3.5.11) 


We now make the following reasonable assumption: The domestic consump- 
tion d;(n) and the imports m,(n) of each country at period (n + 1) are 
proportional to the country’s national income y;(n) one time period earlier. 
Thus, 


di(n+ 1) =anyi(n), mi(n +1) = any: (n), (3.5.12) 
dg(n + 1) = aggye(n), m(n +1) = aygye(n). (3.5.13) 
The constants a,; are called marginal propensities. Furthermore, a;; > 0, 


for i,j = 1,2. Since we are considering a world with only two countries, 
the exports of one must be equal to the imports of the other, i.e., 


m(n) = xo(n), M2(n) = xı (n). (3.5.14) 


Substituting from equations (3.5.12), (3.5.13), and (3.5.14) into (3.5.10) 
and (3.5.11) leads to 


y(n T 1) _ Q11 a12 yi(n) i(n Te 1) 
ie + J g - 2) 4 @ + ») | eee 


Let us further assume that the net investments 71(n) = 71 and ig(n) = i2 
are constants. Then (3.5.15) becomes 


m(n+1)\ fau ai2\ (y(n) ti 
. À = és a Co + (") (3.5.16) 


By the variation of constants formula (3.2.14), we obtain 


n-1 n—-1 
y(n) = A”y(0) + XC APT = Any(0) + XO ATL, (3.5.17) 
r=0 r=0 


where I = (i1,%72)’. To have a stable economy, common sense dictates that 
the sum of the domestic consumption d;(n +1) and the imports m;(n +1) 
in period (n+ 1) must be less than the national income y;(n) in period n; 
that is, 


dj(n+1)+m;(n+1)< y(n)  j=1,2, 
or 
a4, + Q21 < 1, a12 tag < 1. (3.5.18) 


Under conditions (3.5.18), one may show that for all the eigenvalues A of 
A, |A| < 1 (Exercises 3.5, Problem 4). 
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This implies from Corollary 3.24 that A” > 0 as n > oo. This fact fur- 
ther generates the so-called Newmann’s expansion (Exercises 3.5, Problem 
4): 


n-1 foe) 
lim XY ASYA = (I-A. (3.5.19) 
r=0 r=0 


It follows from formula (3.5.17) that 
si _ _ wis 
Jim, y(n) = (I-A; `i. 


This equation says that the national incomes of countries 1 and 2 approach 
equilibrium values independent of the initial values of the national incomes 
yı (0), y2(0). 

However, as we all know, international economics involves many more 
factors than we can account for here. But in Exercises 3.5, Problem 11, 
the student will be allowed to create a model for the economic interaction 
among three countries. 


3.5.5 The Heat Equation 


Example 3.40. Consider the distribution of heat through a thin bar 
composed of a homogeneous material. Let 21, £2,..., £k be k equidistant 
points on the bar. Let T;(n) be the temperature at time tn = (At)n at the 
point x;,1 < i < k. Denote the temperatures at the left and the right ends 
of the bar at time tn by To(n), Ty11(n), respectively. (See Figure 3.3.) 

Assume that the sides of the bar are sufficiently well insulated that no 
heat energy is lost through them. The only thing, then, that affects the 
temperature at the point x; is the temperature of the points next to it, 
which are £i—1,%i+1. Assume that the left end of the bar is kept at b 
degrees Celsius and the right end of the bar at c degrees Celsius. These 
conditions imply that xo(n) = b and zk41(n) = c, for n > 0. 

We assume that the temperature at a given point x; is determined only 
by the temperature at the nearby points x;_; and x;4,. Then according to 
Newton’s law of cooling, the change in temperature T;(n + 1) — T;(n) at a 
point x; from time n to n + 1 is directly proportional to the temperature 
difference between the point x; and the nearby points 7;_, and 2;4,. In 


X X ë X Xi Xk2 Xt Xk 


Xo X 
k+1 


FIGURE 3.3. Heat transfer. 
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other words 
Ti(n + 1) — Ti(n) = a([Ti-1(n) — Ti(n)] 


=a [Ti (n) — Ti(n)]) 
= a[Ti+1(m) — 2T;(n) 


+ 1 
+ Ti-1(n)], (3.5.20) 
or 
T;(n +1) = aT;_1(n) + (1 — 2a)T;(n) + aT; 41(n), =R ee see 
Similarly, one may also derive the following two equations: 

Ti(n +1) = (1 — 2a)Ti(n) + aT (n) + ab, 

Ty (n +1) = aT- (n) + (1 — 2a)Ty(n) + ac. 


This correlation may be written in the compact form 


T(n+1) = AT(n) +49, 


where 
(1 — 2a) a 0 0 ab 
a (1 — 2a) a 0 
A= 0 a (1 — 2a) > 95 
; ; : a 
0 0 0 a (1—2a) me 


This is a tridiagonal Toeplitz matrix.? Its eigenvalues may be found by the 
formula [111] 


NT 
n=(1-2 = at hs a eee 
An = ( a) + acos ("7 ) n 


Hence |A| < 1 for all eigenvalues À of A. Corollary 3.24 then implies that 
lim A” =0. 
noo 


From the variation of constants formula (3.2.12), it follows that 


T(n) = A”T(0) + 5 A"g. 
r=0 


ao ay a2 Ak-1 
-1 ao ay 
2Aisa Toeplitz if it is of the form a_2 a, ao a2 
ay 


QA—k+1 oer a_—2 t A EN ao 
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Thus, limp +o T(n) = (I — A)~'g. Finally, this equation points out that 
the temperature at the point x;,1 < i < k, approaches the ith component 
of the vector (I — A)~'g, regardless of the initial temperature at the point 
Ti. 
Consider the above problem with k = 3, a = 0.4, To(n) = 10° C , T4 (n) = 
20° C. 


Then 
110.2 0.4 0 4 
A=| 04 02 04], g=|0], 
0 04 02 8 
15 5 5 
08 Oa. ay 8 4 8 
(I—A)'=|-04 08 -04 a oe 
4 2 4 
0 —0.4 0.8 13 5 15 
8 4 8 
Hence 
15 5 5 25 
8 4 8 4 > 
lim T(n) = Bese O; =] 15 
13 5 15] \8 29 
8 4 8 2 


Remark: Let Ax = x; — x;-1 and At = t;_1 — ti. If we assume that the 
constant of proportionality a depends on both At and Az, then we may 
write 


= = b, (3.5.21) 


where ĝ is a constant that depends on the material of the bar. Formula 
(3.5.21) simply states that the smaller the value of At, the smaller should be 
the change in the temperature at a given point. Moreover, the smaller the 
separation of points, the larger should be their influence on the temperature 
changes in nearby points. Using formula (3.5.21) in (3.5.20) yields 
At (Ax)? 
If we let At > 0, Ax > 0 as n > œ and i > œ, 2; = (Ax)i = z, and 
t; = (At)i = t, then (3.5.22) gives the partial differential equation 
OT (a, t) T(x, t) 
= : 3.5.23 
Ot R Ox? ( ) 
Equation (3.5.23) is known as the heat equation [137]. 


= B (3.5.22) 
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Exercises 3.5 
1. Consider the difference system 


P(n +1) = RP(n) 


where 
0.2 0.1 0.3 
R=|03 0.5 0.1 
0.5 0.4 0.6 


(a) Show that R is a Markov matrix. 
(b) Find lim, P(n). 
2. Consider the difference system 


P(n +1) = RP(n) 


where 
1 0 03 0.1 
0 1 01 0.2 
R p 
0 0 04 0.3 
0 0 02 0.4 


(a) Show that R is an absorbing Markov matrix. 
(b) Find lim, P(n). 


3. Show that if A is a k x k Markov matrix, then it has an eigenvalue 
equal to 1. 


4. Let A = (aij) be a k x k positive matrix such that D aij < 1 for 
i= 1,2,...,k. Show that |A| < 1 for all eigenvalues \ of A. 


5. Let A be a k x k matrix with |A| < 1 for all eigenvalues \ of A. Show 
that: 


(i) (I — A) is nonsingular. 
(ii) Dio 4 = (I-A). 

6. Modify Example 3.37 by first mating a recessive individual (genes gg) 
with a dominant individual (genes GG). Then, continuing to mate 
the offspring with a dominant individual, write down the difference 
equation that describes the probabilities of producing individuals with 
genes GG, Gg, and gg. Find limno p(n) and then interpret your 
results. 


7. In the dark ages, Harvard, Yale, and MIT admitted only male students. 
Assume that at the time, 80% of the sons of Harvard men went to 
Harvard and the rest went to MIT, 40% of the sons of MIT men went 


10. 


11. 
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to MIT and the rest split evenly between Harvard and Yale; and of 
the sons of Yale men, 70% went to Yale, 20% to Harvard, and 10% 
to MIT. Find the transition matrix R of this Markov chain. Find the 
long-term probabilities that the descendants of Harvard men will go 
to Yale. (Assume that we start with N men, and each man sends one 
son to college.) 


. A New York governor tells person A his intention either to run or not 


to run in the next presidential election. Then A relays the news to B, 
who in turn relays the message to C, and so forth, always to some new 
person. Assume that there is a probability a that a person will change 
the answer from yes to no when transmitting it to the next person 
and a probability @ that he will change it from no to yes. Write down 
the state transition matrix of this process, then find its limiting state. 
Note that the initial state is the governor’s choice. 


. A psychologist conducts an experiment in which 20 rats are placed at 


random in a compartment that has been divided into rooms labeled 1, 
2, and 3 as shown in Figure 3.4. Observe that there are four doors in 
the arrangement. There are three possible states for each rat: It can 
be in room 1, 2, or 3. Let us assume that the rats move from room 
to room. A rat in room 1 has the probabilities pj; = 0, Po; = L, and 
p31 = 2 of moving to the various rooms based on the distribution of 
doors. Predict the distribution of the rats in the long run. What is the 


limiting probability that a given marked rat will be in room 2? 


In Example 3.38 (drunkard’s walk), assume that the probability of a 
step to the right is 3 and that of a step to the left is Z. Write down 
the transition matrix and determine limno p(n). 

In the trade model (Example 3.39) let ai; = 0.4,a21 = 0.5, a12 = 
0.3,a22 = 0.6,i1 = 25 billion dollars, and i = 20 billion dollars. If 
yı(n) and y2(n) denote the national incomes of countries 1 and 2 in 
year n, respectively, and yı(0) = 500 billion dollars and y2(0) = 650 
billion dollars, find y;(3) and y2(3). What are the equilibrium national 
incomes for nations 1 and 2? 


FIGURE 3.4. Diagram for Problem 9. 
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air 50 


water 0 


0 0 0 


FIGURE 3.5. Heat flow diagram for Problem 14. 


12. Develop a mathematical model for a foreign trade model among three 
countries using an argument similar to that used in Example 3.39. 


13. In Example 3.40, let k = 4,a = 0.2, and zo(n) = Ts(n) = 0° C. 
Compute T;(n),1 < i < 4, for n = 1,2,3; then find limp... T;(n). 


14. Suppose we have a grid of six points on a bar as shown in Figure 3.5. 
Part of the bar is in air that is kept at a constant temperature of 50 
degrees, and part of the bar is submerged in a liquid that is kept at 
a constant temperature of 0 degrees. Assume that the temperature at 
the point x;,1 < i < 6, depends only on the temperature of the four 
nearest points, that is, the points above, below, to the left, and to the 
right. 


(i) Write a mathematical model that describes the flow of heat in 
this bar. 


(ii) Find the equilibrium temperature at the six points zi. 


4 
Stability Theory 


In Chapter 1 we studied the stability properties of first-order difference 
equations. In this chapter we will develop the theory for k-dimensional 
systems of first-order difference equations. As shown in Chapter 3, this 
study includes difference equations of any order. Here we are interested 
in the qualitative behavior of solutions without actually computing them. 
Realizing that most of the problems that arise in practice are nonlinear and 
mostly unsolvable, this investigation is of vital importance to scientists, 
engineers, and applied mathematicians. 

In this chapter we adapt the differential methods and techniques of Lia- 
punov [93], Perron [114], and many others, to difference equations. First, we 
introduce the notion of norms of vectors and matrices in Section 4.1. Next, 
we give definitions of various notions of stability and some simple examples 
to illustrate them in Section 4.2. Section 4.3 addresses the question of sta- 
bility of both autonomous and nonautonomous linear systems and includes 
the Stable Mainfold Theorem. In Section 4.4 we study the geometrical prop- 
erties of planar linear systems by means of phase space analysis. Section 4.5 
introduces to the reader the basic theory of the direct method of Liapunov, 
by far the most advanced topic in this chapter. In Section 4.6 we present 
the stability of nonlinear systems by the method of linear approximation, 
which is widely used by scientists and engineers. And, finally, in Section 4.7 
we investigate mathematical models of population dynamics and a business 
model. Due to the enormity of the existing literature on Liapunov theory, 
we have limited our exposition to autonomous equations. 
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(i) the lı norm: 
k 
lle; = dole: } Ixi = 1 


i=l 


(ii) the læ norm: H 
lelle = max le Ixl = 


(iii) the Euclidean norm ly: 


k 1/2 
Izll2 = (>) <p. 
i=l Ixll= 1 


FIGURE 4.1. A circle in different norms. 


4.1 A Norm of a Matrix 


We start this section by introducing the notion of norms of vectors and 
matrices. 


Definition 4.1. A real-valued function on a vector space V is called a 
norm, and is denoted by |||, if the following properties hold: 


(i) ||z|| > 0 and ||a|| = 0 only if z = 0; 
(ii) ||ax|| = |al||z|| for all x € V and scalars a; 
(iii) e + yll < [lal] + llyl for all x,y € V. 


The three most commonly used norms on R* are shown in Figure 4.1. 
We remark here that all norms on R* are equivalent in the sense that if 
Ill, ||||’ are any two norms, then there exist constants a, 3 > 0 such that 


allzl| < llel" < Alla. 


Thus if {xn} is a sequence in R*, then ||z,|| + 0 as n — œ if and only if 
enl + 0 as n > œ. 

Corresponding to each vector norm |||| on R? one may define an operator 
norm |||| on a k x k matrix A as 


A 
(Ala eel, (4.1.1) 
lzl#0_||æl| 
It may be shown easily that 
A|| = max ||Az|| = max ||Azxl|. (4.1.2) 
llæl<1 llel=1 


Using this definition one may easily compute ||A|| relative to the above 
three norms as shown in Table 4.1. (For a proof see [85].) 
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TABLE 4.1. Vector and Matrix Norms. 


Norm lal (|All 
k k 
l Sle ire X lass] Sum over columns 
i=1 i i 


max |x| max 


k 
1<i<k 1<i<k X |aij] Sum over rows 
<i< Sisk £ 


i ($) [o(A™A)] ? 


From (4.1.1) we may deduce that for any operator norm on A (Exercises 
4.1, Problem 5), 


p(A) < ||All, (4.1.3) 


where p(A) = max{|A| : À is an eigenvalue of A} is the spectral radius of 
A. 


Exercises 4.1 


1. Compute || Allı, ||Alloo, ||All2, and p(A) for the following matrices: 


TE 1 1 2 2 1 0 
W gf. @) Jo 2-1]. (fo 2 0 
0 3 0 03 4 


2. Give an example of a matrix A such that p(A) F ||Alloo, || Alla, || Alla. 


3. Let 
A 1 0 
A=]0 A 1 
0 0 A 
Show that for each £ > 0 there exists a diagonal matrix D such that 
||D~'AD]|| < |A| + £ for operator norms || Al]; || A]l.o- 


4. Generalize Problem 3 to any k x k matrix A in the Jordan form 
diag( Jı, Jo, Eey Jy). 


5. Prove that p(A) < ||A|| for any operator norm |||| on A. 
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6. Show that for any two norms |||], ||||’ on R* there are constants a, 3 > 0 
such that alla) < |lal’ < Giz. 


7. Deduce from Problem 6 that for any sequence {x(n)}, ||x(n)|| — 0 as 
n — oo if and only if ||x(n)||’ > 0. 


4.2 Notions of Stability 


Let us consider the vector difference equation 
a(n +1) = f(n,x(n)), x(no) = Xo, (4.2.1) 


where x(n) € R*, f : Z+ x RE — R*. We assume that f(n, x) is continuous 
in x. Recall that (4.2.1) is said to be autonomous or time-invariant if the 
variable n does not appear explicitly in the right-hand side of the equation 
f(n,x(n)) = f(x(n)). It is said to be periodic if for all n € Z, f(n+N, x) = 
f(n,x) for some positive integer N. 

A point x* in R* is called an equilibrium point of (4.2.1) if f(n, £*) =x 
for all n > ng. In most of the literature x* is assumed to be the origin 0 
and is called the zero solution. The justification for this assumption is as 
follows: Let y(n) = a(n) — x*. Then (4.2.1) becomes 


y(n + 1) = f(r, y(n) + 2") — x* = g(n, y(n). (4.2.2) 


Notice that y = 0 corresponds to x = «*. Since in many cases it is not 
convenient to make this change of coordinates, we will not assume that 
x* = 0 unless it is more convenient to do so. 

Recall that in Chapter 3 we dealt with the existence and uniqueness of 
solutions of linear systems, that is, the case f(n,a(n)) = A(n)x(n), where 
A(n) isa k x k matrix. The existence and uniqueness of solutions of (4.2.1) 
may be established in a similar fashion (Exercises 4.2, Problem 9). 

We are now ready to introduce the various stability notions of the 
equilibrium point x* of (4.2.1). 


* 


Definition 4.2. The equilibrium point x* of (4.2.1) is said to be: 


(i) Stable (S) if given £ > 0 and no > 0 there exists 6 = ô(£€, no) such that 
||vo — x* || < ô implies ||x(n, no, zo) — x*|| < £ for all n > no, uniformly 
stable (US) if ô may be chosen independent of no, unstable if it is not 
stable. 


— 
(aes 
me 

Na 


Attracting (A) if there exists u = pu(no) such that ||xro — 2*|| < u 
implies limp... £(n, no, zo) = x*, uniformly attracting (UA) if the 
choice of u is independent of no. The condition for uniform attractivity 
may be paraphrased by saying that there exists u > 0 such that for 
every £ and no there exists N = N(e) independent of no such that 
x(n, no, zo) — z*|| < € for all n > no + N whenever ||xo — x*|| < u. 
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A. 
oy 


FIGURE 4.2. Stable equilibrium in phase space. 


(iii) Asymptotically stable (AS) if it is stable and attracting, and uniformly 
asymptotically stable (UAS) if it is uniformly stable and uniformly 
attracting. 


(iv) Exponentially stable (ES) if there exist ô > 0, M > 0, and ņ € (0,1) 
such that ||x(n, no, zo) — 2*|| < Mao — z* ||)", whenever ||ao — 
x*|| < ô. 


(v) A solution z(n, no, xo) is bounded if for some positive constant M, 
|x (n, no, zo)|| < M for all n > no, where M may depend on each 
solution. 


If in parts (ii), (iii) u = œœ or in part (iv) 6 = oo, the corresponding stability 
property is said to be global. In Figure 4.2, we suppress the (time) n and 
show only the movement of a solution that starts inside a ball of radius ô. 
The figure illustrates that all future states z(n, no, xo), n > no, will stay 


FIGURE 4.3. Stable equilibrium. 
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S ——_ us 


FIGURE 4.5. Hierarchy of stability notions. 


within the € ball. This diagram is called a phase space portrait and will be 
used extensively in later sections. In Figure 4.3 the time n is considered part 
of a three-dimensional coordinate system that provides another perspective 
on stability. Figure 4.4 depicts the uniform asymptotic stability of the zero 
solution. 

Note that in the above definitions, some of the stability properties auto- 
matically imply one or more of the others. Figure 4.5 shows the hierarchy 
of the stability notions. 


Important Remark: In general, none of the arrows in Figure 4.5 may be 
reversed. However, for special classes of equations, these arrows in Figure 
4.5 may be reversed. In this section, it will be shown that for linear systems 


x(n +1) = A(n)a(n) (4.2.3) 


where A(n) is a k x k matrix defined on Z*, uniform asymptotic stability 
implies exponential stability (U AS = ES). 
For the autonomous system 


a(n +1) = f(zx(n)) (4.2.4) 


we have the following result. 
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Theorem 4.3. For the autonomous system (4.2.4), the following state- 
ments hold for the equilibrium point x*: 


(i) SOUS. 
(ii) AS 6 UAS. 
(iii) AG UA. 


PROOF. 


(i) Let x(n, no, zo) and y(n, mo, Lo) be two solutions of (4.2.4), with mp = 


The proofs of (ii) and (iii) are similar to the proof of (i). 


no+ro, ro > 0. Notice that £(n—ro, no, xo) intersects with y(n, mo, Xo) 
at n = mo. By uniqueness of solutions, it follows that y(n, mo, zo) = 
x(n — ro, no, £o). This implies that the ô in the definition of stability 
is independent of the initial time no which establishes our result. 


The following examples serve to illustrate the definitions. 


1. 


The solution of the scalar equation x(n + 1) = a(n) is given by 
x(n, no, £o) = Xo; hence the zero solution is uniformly stable but not 
asymptotically stable. 


. The solutions of the scalar equation x(n + 1) = a(n)a(n) are 


x(n, no, zo) = i a) To. (4.2.5) 


i=no 
Hence one may conclude the following: 


(i) The zero solution is stable if and only if 


n—1 


[[ e@ 


i=N0o 


< M(no) = M, (4.2.6) 


where M is a positive constant that depends on ng (Exercises 
4.2, Problem 2). This condition holds if a(i) = (1 + 7"), where 
O0<n<l. 


To show this we write the solution as x(n, no, Xo) = ®(n)ao, where 
®(n) = JFZ} (1 +n’). Since 1+ nî < exp(n’), it follows that 


i=Nn0o 
n-1 co nro 
P(n) < g DES 
) se ( r) con 5 r) e (1) 
w=no =n 


Given £ > 0 and ng > 0, if we let 6 = £€/(2M), then |x| < 6 
implies |x(n, no, zo)| = (n)zo < €. 
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(ii) The zero solution is uniformly stable if and only if 


n—1 


J| 


i=No 


<M, (4.2.7) 


where M is a positive constant independent of no (Exercises 4.2, 
Problem 5). This condition holds if a(i) = sin(i + 1). 


(ii) The zero solution is asymptotically stable if and only if 
n-1 
Jim, I a(i) =0 (4.2.8) 
I=no 


(Exercises 4.2, Problem 5). This condition clearly holds if a(i) = 
iti. The solution is given by æ(n, no, xo) = (no + 1)/(n + 1)a0. 
Thus, the zero solution is uniformly stable and asymptotically 
stable (globally), but not uniformly asymptotically stable. (Why?) 


(See Exercises 4.2, Problem 6.) 


(iv) The zero solution is uniformly asymptotically stable (and thus 
exponentially stable) if and only if 


n—1 


I] 


i=no 


< Mn”, (4.2.9) 


for some M > 0,0 < 7 < 1. This may be satisfied if a(i) = 1/i 
(Exercises 4.2, Problem 8). 


Now we give two important examples. In the first example we show that 
the zero solution is stable but not uniformly stable. In the second example 
the zero solution is attracting but not stable (personal communication by 
Professor Bernd Aulbach). 


Example 4.4. The solution of the equation x(n + 1) = (44+) [z(n)]? is 
given by 


gr—no-l 


simnnes) = (5) (St) e (ME) or 


x(no) = Xo. 


If |x| is sufficiently small, then limy_,.. z(n) = 0. Thus, the zero solution 
is attracting. However, it is not uniformly attracting. For if 6 > 0 is given 
and no is chosen such that (no + 1)6? > 2, then, for |xo| = 6, 


no +1 
jena + 1m, )] = (2) lao? > 1 


Let us now check the stability of the zero solution. Given £ > 0 and ng > 0, 
let ô = £€/ (no +1). If |xo| < ô, then |a(n, no, xo)| < € for all n > no. Since ô 
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depends on the choice of no, the zero solution is stable but not uniformly 
stable. 


Example 4.5. Consider the difference equation (in polar coordinates) 
r(n+1) = Yr(n), r>0, 
O(n +1) = V270(n), 0<0<2r. 


We claim that the equilibrium point (1,0) is attracting but not stable. To 
show this, observe that 


r(n) = re ro = r(0), 
O(n) = (2m)(-2-") . (00), 8o = (0). 


Clearly, limno r(n) = 1 and limno O(n) = 2r. Now, if ro 4 0, 6o = 0, 
then (r(n),0(n)) = ((ro)? ”,0), which converges to the equilibrium point 
(1,0). However, if 0) = 67,0 < 6 < 1, then the orbit of (ro, 0o) will spiral 
around the circle counterclockwise to converge to the equilibrium point 
(1,0). Hence the equilibrium point (1,0) is attracting but not stable. (See 
Figure 4.6.) 


Remark: The situation in Example 4.5 is a higher dimension phenomenon. 
In 1997, Sedaghat [132] showed that a continuous map on the real line 
cannot have an attracting unstable fixed point. 


To demonstrate this phenomenon, let us contemplate the following 
example: 


Example 4.6. Consider the map 


Gla) —2x ifx< p, 
t) = 
7 0 if x > p, 


FIGURE 4.6. Attracting but not stable equilibrium. 


182 4. Stability Theory 


FIGURE 4.7. Go(z). 


where u € Rt. Equivalently, we have the difference equation x(n + 1) = 
G,(z(n)) whose solution is given by 


(—2)"x9 if (—2)"—129 < u, 


x(n) = Gi (xo) = 0 if (—2)"T tzo > u, 


where x(0) = zo. 

Now, if £o > p, then Gii(xo) = 0 for all n > 1. On the other hand, if 
to < p, then for some k € Z+, G} (xo) > u. Hence, G? (xo) = 0 for all 
n >k. 

Hence the fixed point x* = 0 is globally attracting. However, x* = 0 is 
unstable, for points zo that are close to 0 are mapped to points further 
away from 0 until they exceed u (see Figure 4.7 for G2). 


Theorem 4.7 [132]. A continuous map f on the real line cannot have 
an attracting unstable fixed point. 


To facilitate the proof of the theorem, we first establish a stability result 
that is of independent interest, since it does not require differentiability of 


f. 


Criterion for asymptotic stability of fixed points 
of nondifferentiable maps. 


Theorem 4.8 [135]. A fixed point x* of a continuous map f is asymp- 
totically stable if and only if there is an open interval (a,b) containing x* 
such that f?(x) >x fora <x < z* and f?(x) < x fora* <a <b. 


PROOF. See Appendix C. 


PROOF OF THEOREM 4.7. Let f be a continuous map on R that has an 
unstable globally attracting fixed point x*. This implies that the equation 
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f?(x) = z has only one solution x = x*. Hence, there are only two possible 
cases: 


(a) f(x) >x for x < x* and f?(x) < x for x > 2*; 
(b) F? (x) < x for x < x* and f?(x) > 2 for z > 2*. 


Notice that by Theorem 4.8, case (a) implies that x* is asymptotically 
stable and must be discarded. It remains to rule out case (b). So assume 
that f?(x) < x for x < x*. Now let xq < x*. Then by iteration, we have 
s < f (xo) < f?(@0) < £o < 2". 

Thus, f?” (xo) does not converge to x*, which contradicts the global 
attractivity of x*. The case f?(x) >x for x > x* is similar and will lead to 
a contradiction. Hence, our assumption is false, which proves the assertion 
of the theorem. 


Exercises 4.2 
1. Meditate upon the scalar equation x(n + 1) = ax(n). Prove that: 
(i) If |a| < 1, the zero solution is uniformly asymptotically stable. 
) If |a| = 1, the zero solution is uniformly stable. 
(iii) If |a| > 1, the zero solution is not stable. 
) 


Prove that the zero solution of the scalar equation x(n + 1) = 

a(n)a(n) is stable if and only if neem ali)| < M(no), where M 
depends on no. 

(b) Show that the zero solution of the equation x(n +1) = (1+ 

n”)x(n),0 <n < 1, is stable. 


3. (a) Prove that the zero solution of the equation x(n + 1) = a(n)x(n) 
is uniformly stable if and only if i, a(i)| < M, where M is a 
positive constant independent of no. 


(b) Show that the zero solution of the equation a(n + 1) = sin(n + 
1)z(n) is uniformly stable. 


4. Show that the zero solution of the equation a(n + 1) = 25 x(n) is 
asymptotically stable. 


5. Prove that the zero solution of the equation x(n + 1) = a(n)z(n) is 


asymptotically stable if and only if limpo jie a(i)| =0. 


1=No 
6. Show that the zero solution of the equation in Problem 4 is not 
uniformly asymptotically stable. 
7. Prove that the zero solution of the equation x(n) = a(n)a(n) is uni- 
We a(i)| < Mn"—”°, for 


formly asymptotically stable if and only if 
some M>0,0<7 <1. 
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8. Show that the zero solution of the scalar equation x(n + 1) = 
(1/n)x(n),n > 1, is uniformly asymptotically stable. 
9. Establish the existence and uniqueness of solutions of (4.2.1). 


10. Consider the system 


a(n+1) = a(n) + 


[2%(n) + yn) [o4(n) + POD 
en wP(n)(y(n) — 22(n)) 
y(n + 1) = y(n) [x2(n) + y2(n)] + [x (n) + ym 


which can be written as 
x(n +1) = a(n) + gi(a(n),y(n)), 
y(n + 1) = y(n) + g2(x(n), y(n)). 
Show that the zero solution is globally attracting but unstable. 


Ww 


11. Define the difference equation on the unit circle as 
r(n+1)=1, 
O(n+1)=V2r0, 0<0<2r. 


Show that the fixed point (1,0) is globally attracting but unstable. 


4.3 Stability of Linear Systems 


4.3.1 Nonautonomous Linear Systems 


In this subsection we investigate the stability of the linear nonautonomous 
(time-variant) system given by 


a(n+1)=A(n)a(n), n>no > 0. (4.3.1) 
It is always assumed that A(n) is nonsingular for all n > no. 

If ®(n) is any fundamental matrix of system (4.3.1) or (4.3.6), then recall 
that P(n, m) = 6(n)®~1!(m) is the state transition matrix. In the following 
result we express the conditions for stability in terms of a fundamental 
matrix ®(n) of system (4.3.1). 

Theorem 4.9. Consider system (4.3.1). Then its zero solution is 
(i) stable if and only if there exists a positive constant M such that 
|®(n)|| <M forn > no = 0; (4.3.2) 
(ii) uniformly stable if and only if there exists a positive constant M such 


that 
|®(n,m)|| <M forng <m<n<ow; (4.3.3) 
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(iii) asymptotically stable if and only if 
Jim, ||®(n)|| = 0; (4.3.4) 


(iv) uniformly asymptotically stable if and only if there exist positive 
constants M and 7 € (0,1) such that: 


|®(n,m)|| < Mn”  forno <m<n<o. (4.3.5) 


ProoF. Without loss of generality we may assume that ®(no) = I, since 
conditions (4.3.2) through (4.3.5) hold true for every fundamental matrix 
if they hold for one. Thus x(n, no, zo) = ®(n)xo. 


(i) Suppose that inequality (4.3.2) holds. Then ||x(n, no, 20)|| < M]||zoll. 
So for € > 0, let 6 < €/M. Then ||zol| < ô implies ||z(n, no, x0)|| < 
€ and, consequently, the zero solution is stable. Conversely, suppose 
that ||a(n, no, xo) || = ||®(m)ao]| < € whenever ||2o|| < 6. Observe that 
||zo|| < 6 if and only if $||zo|| < 1. Hence 


E 


M. 
ô 


[Em = sup |s] `- sup ||®(n)zol| < 
g\|<1 zoll <5 


Parts (ii) and (iii) remain as Exercises 4.3, Problems 9 and 10. 


(iv) Suppose finally that inequality (4.3.5) holds. The zero solution of sys- 
tem (4.3.1) would then be uniformly stable by part (ii). Furthermore, 
for e > 0,0 < € < M, take u = 1 and N such nï < €/M. Hence, 
if ||xzo]| < 1, then |la(n, no, zo)|| = ||®(n,n0)aol] < Mn?" < e for 
n > no + N. The zero solution would be uniformly asymptotically 
stable. Conversely, suppose that the zero solution is uniformly asymp- 
totically stable. It is also then uniformly stable, and thus by Theorem 
5.1 (ii), ||®(n,m)|| < M for 0 < no < m < n < œ. From uniform 
attractivity, there exists 4 > 0 such that for e with 0 < e < 1 
there exists N such that ||®(n,no)|| < ¢ for n > no + N, whenever 
||xol| < u. This implies that M®(n, no)|| < £ for n > no + N. Then for 
ne[no + MN, no + (m + 1)N], m > 0, we have 


|P(n, no)l| < ||P (n, no + MN)II||E (no + MN, no + (m — 1)N)|| x 
“++ X ||®(n9 + N, no)|| 


m N f 
< Me™ < M (x)! ae = Myr DN 
& 
< Mn"), 


for mN <n—1no < (m+ 1)N where M = “q= eN. This concludes 
the proof of the theorem. 


The following result arises as an immediate consequence of the above 
theorem. [See the Important Remark, part (i).] 
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Corollary 4.10. For the linear system (4.3.1) the following statements 
hold: 

(i) The zero solution is stable if and only if all solutions are bounded. 


(ii) The zero solution is exponentially stable if and only if it is uniformly 
asymptotically stable. 


PROOF. Statements (i) and (ii) follow immediately from conditions (4.3.3) 
and (4.3.5), respectively (Exercises 4.3, Problem 6). 


The following is another important consequence of Theorem 4.9: 


Corollary 4.11. For system (4.3.1), every local stability property of the 
zero solution implies the corresponding global stability property. 


PROOF. Use Theorem 4.9 (Exercises 4.3, Problem 7). 


We now give a simple but powerful criterion for uniform stability and 
uniform asymptotic stability. 


Theorem 4.12 [17]. 


eae ayj(n)| < 1,1 < j < k,n > no, then the zero solution o 
i=1 [Mij J 
system (3.2.15) is uniformly stable. 


i) 5 ajj(n)| < 1— v for some v > 0,1 < j < k,n > no, then the 
I=L J 
zero solution is uniformly asymptotically stable. 


PROOF. 


(i) From condition (i) in Theorem 4.12, || A(n)||1 < 1 for all n > no. Thus, 
n-1 
[4o 


This now implies uniform stability by Theorem 4.9, part (ii). 


[8 (n, m)l = < Am- Dhl Am- Jh Amla < 1. 


1 


(ii) The proof of statement (ii) is so similar to the proof of statement (i) 
that we will omit it here. 


4.3.2 Autonomous Linear Systems 


In this subsection we specialize the results of the previous section to 
autonomous (time-invariant) systems of the form 


a(n +1) = Az(n). (4.3.6) 


In the next theorem we summarize the main stability results for the 
linear autonomous systems (4.3.6). 


Theorem 4.13. The following statements hold: 
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(i) The zero solution of (4.3.6) is stable if and only if p(A) < 1 and the 
eigenvalues of unit modulus are semisimple.! 


(ii) The zero solution of (4.3.6) is asymptotically stable if and only if 
p(A) <1. 


PROOF. 


(i) Let A= PJP}, where J = diag(J1, Jo,...,J,) is the Jordan form of 
A and 


À 1 0 
ri 
J, = 
1 
0 Ài 


From Theorem 4.9 the zero solution of (4.3.6) is stable if and only if 
||A"|| = ||PI"P~*|| < M or ||J"|| < M, where M = M/(||PIIIP="). 
Now, J” = diag( JI, J?,..., J£), where 


ar (P) mY yn-sitt 
u 1 KA s;— 1 a 

n n—1 
(1) 


0 0 si x 


Obviously, J? becomes unbounded if |\;| > 1 or if |A| = 1 and J; 
is not 1 x 1. If |A;| < 1, then J? — 0 as n > oo. To prove this 
conclusion it suffices to show that |\;|" nf > 0, as n > oo for any 
positive integer /. This conclusion follows from L’Ho6pital’s rule, since 
|r|” nf = nfl iD” (Exercises 4.3, Problem 8). 


(ii 


Sa 


The proof of statement (ii) has already been established by the above 
argument. This completes the proof of the theorem. 


Explicit Criteria for Stability of Two-Dimensional Systems 


In many applications one needs explicit criteria on the entries of the matrix 
for the eigenvalues to lie inside the unit disk. So consider the matrix 


' An eigenvalue is said to be semisimple if the corresponding Jordan block is 
diagonal. 
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whose characteristic equation is given by 
A? — (a11 + a22)À + (11422 — 212421) = 0 
or 
A? — (tr A)A + det A = 0. (4.3.7) 
Comparing (4.3.7) with the equation 
+ pir + po = 0, 


where pı = —tr A, po = det A, we conclude from Theorem 2.37 that the 
eigenvalues of A lie inside the unit disk if and only if 


1+trA+detA>0, 1-—trA+detA>0, 1l—detA>0 (4.3.8) 


or, equivalently, 


ltr Al <1+det A <2. (4.3.9) 


It follows that under condition (4.3.9), the zero solution of the equation 
a(n+1) = Aaz(n) 


is asymptotically stable. 

We now describe the situation when some eigenvalues of A in (4.3.6) are 
inside the unit disk and some eigenvalues are outside the unit disk. The 
result below is called the Stable Subspace (Manifold) Theorem. The result 
does not require that A is invertible. 

Let A be an eigenvalue of A of multiplicity m and let £1, €2,...,&m be the 
generalized eigenvectors corresponding to A. Then for each i, 1 <i < m, 
either 


Ai = Aĉ; (&; is an eigenvector of A), or 
Ai = ASi + &-1.- 


It follows that the generalized eigenvectors corresponding to A are the 
solutions of the equation 


(A—dJ)™E = 0. (4.3.10) 


The set of all linear combinations, or the span of the generalized eigenvec- 
tors corresponding to A is invariant under A and is called the generalized 
eigenspace F) of the eigenvalue of A. Clearly, if A1 # Ao, then Fy, NF), = 
{0}. Notice that each eigenspace Æ, includes the zero vector. 

Assume that A is hyperbolic, that is, none of the eigenvalues of A lie on 
the unit circle. Arrange the eigenvalues of A such that A, = {\1,A2,---,Ar} 
are all the eigenvalues of A with |A| < 1,1 < i < rand A, = 
{\r41,Arts,---,Ak} are all the eigenvalues of A with |A;| > 1,r+1<i<k. 
The eigenspace spanned by the eigenvalues in A, is denoted by W*, where 
Ws = |J; à; and the eigenspace spanned by the eigenvalues in A, is 


denoted by W“, where W” = Ha Ài- 
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Theorem 4.14 (The Stable Subspace (Manifold) Theorem). IfA 
is hyperbolic, then the following statements hold true: 


(i) If x(n) is a solution of (4.3.6) with 7(0) e€ W°, then for each n, x(n) € 
W°. Furthermore, 


Jim, x(n) = 0. 


(ii) If x(n) is a solution of (4.3.6) with «(0) € W”, then x(n) € W” for 


each n. Moreover, 


lim. x(n) = 0. 


PROOF. 

(i) Let x(n) be a solution of (4.3.6) with z(0) € W5. Since AE) = Ey, it 
follows that AW* = W°. Hence x(n) € W° for all n € Z*. To prove 
the second statement, observe that x(0) = S>_, ci€;, where 1 <& < r 


are the generalized eigenvectors corresponding to elements in A,. Let 
J = P~'AP be the Jordan form of A. Then J may be written in the 


form 
J, 0 
J= 
0 Ju 


where J, has the eigenvalues in A, and J, has the eigenvalues in 
Aw. By Lemma 3.27 in Chapter 3, the corresponding generalized 
eigenvectors &,, 1 < i < r, of J, are of the form & = Plé; = 
(ail, Qi2, sae , Air, 0, 0, EES 0)?. Now 


x(n) = A”x(0) 


= PJP P7! 5 Cb; 
i=1 


i=l 


Thus limpo £(n) = 0 since J? + 0 as n > oo. 


(ii) The proof of (ii) is analogous to (i) and will be left to the reader as 
Problem 11. 


Remark: 


(i) Part (i) may be obtained without the condition of hyperbolicity of A, 
and similarly for part (ii). 
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(ii) The General Stable Manifold Theorem for Nonlinear Maps will be given 
in Appendix D. 


We now use the above result to investigate the stability of the periodic 
system 


x(n+1) = A(n)a(n), A(n +N) = A(n). (4.3.11) 


Recall from Chapter 3 that if ®(n, no) is a fundamental matrix of (4.3.11), 
then there exist a constant matrix B whose eigenvalues are called the 
Floquet exponents and a periodic matrix P(n,no) such that ®(n,no) = 
P(n,n9)B"—", where P(n + N,no) = P(n,no). Thus if B” is bounded, 
then so is ®(n,no), and if B” > 0 as n — ov, then it follows that 
(n, no) > 0 as n > oo. This proves the following result. 


Theorem 4.15. The zero solution of (4.3.11) is: 


(i) stable if and only if the Floquet exponents have modulus less than or 
equal to 1; those of modulus of 1 are semisimple; 


(ii) asymptotically stable if and only if all the Floquet exponents lie inside 
the unit disk. 


For practical purposes, the following corollary is of paramount impor- 
tance. 


Corollary 4.16. The zero solution of (4.3.11) is: 


(i) stable if and only if each eigenvalue of the matrix C = A(N —1)A(N — 
2)--- A(0) has modulus less than or equal to 1; those solutions with 
modulus of value 1 are semisimple; 


(ii) asymptotically stable if and only if each eigenvalue of 
C = A(N — 1)A(N — 2)--- A(0) has modulus less than 1. 


Let us summarize what we have learned thus far. First, for the au- 
tonomous (time-invariant) linear system x(n +1) = Ax(n), the eigenvalues 
of A determine the stability properties of the system (Theorem 4.13). But 
for a periodic system x(n + 1) = A(n)a(n), the eigenvalues of A(n) do not 
play any role in the determination of the stability properties of the sys- 
tem. Instead, the Floquet multipliers of A(n) determine those properties. 
The following example should dispel any wrong ideas concerning the role 
of eigenvalues in a nonautonomous system. 


Example 4.17. Let us again consider the periodic system in Example 
3.35 where 


; 2+(-1)" 
2 
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Here the eigenvalues of A are +V3/2, and thus p[A(n)] < 1. By applying 
Corollary 4.16, one may quickly check the stability of this system. We have 


3 1 9 
2 
0 
2 2 4 
Hence, by Corollary 4.16, the zero solution is unstable, since C has an 
eigenvalue 9/4 which is greater than 1. 
For the eager reader, perpetually searching for a challenge, we might 


determine the stability by explicitly transcribing the fundamental matrix 
as follows: 


Hence, these are unbounded solutions. Consequently, the zero solution 
is unstable. This example demonstrates without any doubt that eigen- 
values do not generally provide any information about the stability of 
nonautonomous difference systems. 


Exercises 4.3 


1. Determine whether the zero solution of the system x(n + 1) = Ax(n) 
is stable, asymptotically stable, or unstable if the matrix A is: 


es 1 
o 12 2 
1 5 
i b|- -= 2 
(a) > 4] (Baba a 
1 
wH 
I5 Ah ai 
ofa (a) | -1.5 -0.5 15 
Peeni l 51 
05 1 0 


2. Give another example (see Example 4.17) of a matrix A(n) such that 
p|A(n)] < 1 and the zero solution of x(n + 1) = A(n)z(n) is unstable. 


3. Give an example of a stable matrix A (i.e., p(A) < 1) with ||Al] > 1, 
for some matrix norm |||. 


4. Consider the autonomous (time-invariant) system (4.3.6). Prove the 
following statements: 


(i) The zero solution is stable if and only if it is uniformly stable. 
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(ii) The zero solution is asymptotically stable if and only if it is 
uniformly asymptotically stable. 
5. Use Corollary 4.16 to determine whether or not the zero solution of 


«(n+ 1) = A(n)2(n) is uniformly stable or uniformly asymptotically 
stable, where A(n) is the matrix: 


1 
—1 Z cos(n) i 0 
{4 | (b) | n= 
0 5 sin(7) — 1 
1 1 
: +2 
ae 0 z sin(n) == 0 0 
1 1 1 
(c) i 5 sin(n) —cos(n) (d) 0 1 0 
1 
1 1 
50 0 n+l ° 


6. Prove Corollary 4.10. 
7. Prove Corollary 4.11. 


8. Show that if |A| < 1, then lim,-... |A|"n* = 0 for any given positive 
integer s. 


9. Prove that the zero solution of system (4.3.1) is uniformly stable if and 
only if there exists M > 0 such that ||®(n,m)|| < M, for no < m < 
n < ow. 


eR 


0. Prove that the zero solution of system (4.3.1) is asymptotically stable 
if and only if limno || ®(n)|| = 0. 


11. Prove Theorem 4.14, part (ii). 
Iterative Methods 
Consider the system of linear algebraic equations 
Ax = b, (4.3.12) 


where A = (a;;) is a k x k matrix. 
Iterative methods are used widely to solve (4.3.12) numerically. We 
generate a sequence x(n) using the difference equation 


a(n+1) = Ba(n) +d, (4.3.13) 
where the choice of B and d depends on the iterative method used. The 
iterative method (4.3.13) is consistent with (4.3.12) if a solution x* of 
(4.3.12) is an equilibrium point of (4.3.13), i.e., if 

Ba*+d=2". (4.3.14) 
We now describe one such consistent method, the Jacobi iterative method. 
Assuming that the diagonal elements a;; of A are nonzero, then D = 
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diag(a11, a22, . - - , akk) is nonsingular. In (4.3.13) define 
B=I-D"A, d= Db (4.3.15) 


This method is consistent (Exercises 4.3, Problem 12). If A is nonsingular, 
then x* is unique. The associated error equation may be derived by letting 
e(n) = x(n) — «*. Equations (4.3.13) and (4.3.14) then yield the equation 


e(n + 1) = Be(n). (4.3.16) 


The quantity e(n) represents the error in approximating the solution x* by 
the nth iterate x(n) of (4.3.13). 


12. (i) Prove that 2(n) => x* as n > oo if and only if e(n) — 0 as 
n — oo. In other words, the iterative method ((4.3.13) converges 
to the solution «* of (4.3.12) if and only if the zero solution of 
(4.3.16) is asymptotically stable). 


(ii) Use Theorem 4.9 to show that the iterative method converges if 
and only if p(B) < 1. 


13. Show that the Jacobi iterative method is consistent. 


14. Consider (4.3.12) and (4.3.13) with the assumption that the diagonal 
elements of A are nonzero. Let L be the lower triangular part of A 
and let U be the strictly upper triangular part of A (i.e., the main 
diagonal of U is zero). Then A = L + U. The Gauss-Seidel iterative 
method defines B = —L~1U and d= L~1bd. Show that this method is 
consistent. 


In Problem 15 we consider the k-dimensional system x(n + 1) = A(n)a(n). 
*15. (a) Define H(n) = AT (n)A(n). Prove the Lagrange identity 
e(n +.1)|]3 = a? (n + 1)e(n +1) = 27 (n)H(n)a(n). (4.3.17) 


(b) Show that all eigenvalues of H(n) as defined in part (a) are real 
and nonnegative. 


(c) Let the eigenvalues of H(n) be ordered as Ai (n) < A2(n) <- < 
A(n). Show that, for all z € R”, 


Ai(n)a? a <a? H(n)x < »;(n)a? z. (4.3.18) 


(d) Use the Lagrange identity (4.3.17) in formula (4.3.18) to show 
that 
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(e) Show that 


I Ar(i) < ||®(n, no) <T Ar (i (4.3.19) 


i=no i=ny 


4.4 Phase Space Analysis 
In this section we will study the stability properties of the second-order 
linear autonomous (time-invariant) systems 


zın +1) = agzi (n) + ay2X2(n), 


vo(n + 1) = azzi (n) + az2x£2(1N), 


or 
x(n +1) = Az(n), (4.4.1) 


where 


Recall that x* is an equilibrium point of system (4.4.1) if Av* = a* 


or (A — I)x* = 0. So if (A — J) is nonsingular, then «* = 0 is the only 
equilibrium point of system (4.4.1). On the other hand, if (A—J) is singular, 
then there is a family of equilibrium points, as illustrated in Figure 4.8. In 
the latter case we let y(n) = x(n) — x* in (4.4.1) to obtain the system 
y(n +1) = Ay(n), which is identical to system (4.4.1). Thus the stability 
properties of any equilibrium point «* 4 0 are the same as those of the 
equilibrium point x* = 0. Henceforth, we will assume that 2* = 0 is the 
only equilibrium point of system (4.4.1). 

Let J = P~'AP be the Jordan form of A. Then J may have one of the 


following canonical forms: 
àA 1 
l maa (4.4.2) 
O A -6 a 


à 0 
0 AJ” 


(a) (b) (c) 
distinct real repeated real complex conjugate 
eigenvalues eigenvalue A eigenvalues 

At, A2 A=axtiZ 
If we let 
y(n) = P~*a(n), 
or 


x(n) = Py(n), (4.4.3) 
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< 


FIGURE 4.8. Ai < A2 < 1, asymptotically stable node. 


then system (4.4.1) becomes 
y(n +1) = Jy(n). (4.4.4) 


If x(0) = zo is an initial condition for system (4.4.1), then y(0) = yo = 
P~‘xo will be the corresponding initial condition for system (4.4.4). Notice 
that the qualitative properties of the equilibrium points of systems (4.4.1) 
and (4.4.4) are identical. 

Our program is to sketch the phase space of system (4.4.4) in cases (a), 
(b), and (c). Starting with an initial value 


Y10 
Yo = 
(e) 


in the y1y2-plane, we trace the movement of the points y(1), y(2), y(3),.... 
Essentially, we draw the orbit {y(n,0, yo)|n > 0}. An arrow on the orbit 
indicates the direction of motion as time increases. 


Case (a). In this case the system becomes 


yi(n +1) = ày (n), 
yo(n + 1) = à2y2(1). 


Hence 


and thus 


am (Xy (2). 


[y2 


9€ 
I 
gy. 
n 
fo) 
© 
4 
z 
og 
c 
5 
D 
n 
= 
20 
= 
so 
m 
2 
© 
= 
z 
Ea 
= 
2 
N 
5 


limno 
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FIGURE 4.9. 1 > A2 > 1, unstable node. 


FIGURE 4.10. 0 < Ay < 1,A2 > 1, saddle (unstable). 


Case (b). In this case, 
(oa) = (Crm) = (oo) (Cr) 
y2(n) Y20 0 A” yoo) jJ 


"yng + NA” ty, 


or 


y(n) = 
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pect > Y; 


FIGURE 4.11. 0 < Ai = A2 < 1, asymptotically stable node. 


e L Ld Yo @ LJ (J 
+ tf aon eee 
ae aa oa oe 


FIGURE 4.12. Ay = 1,A2 < A1, degenerate node. 


Thus 


(See Figures 4.13, 4.14.) 
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Case (c). In this case, the matrix A has two complex conjugate eigenvalues, 


Ay =atiB and A»=a-— iP, BAD. 
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ee | 


FIGURE 4.13. Ai = A2 < 1, asymptotically stable. 


Y2 
e 4 > ° 
e o> + di > ad 
> y, 
e—<—e - <—* s 
e < . 


FIGURE 4.14. \1 = A2 = 1, degenerate case (unstable). All points on the y1-axis 
are equilibrium points. 


1 
The eigenvector corresponding to 41 = a+ iĝ is given by é = al and 
i 


the solution may be given by 


1 1 
() (a +i)" = a |Ai|" (cos nw + isin nw), 
(3 (7 
n | cosnw ay n { Sinnw 
=|A1| + iA; | 
SIN nw COS NW 
where w = tan~1(G/a). 


A general solution may then be given by 


yi(r)\ ial C1 COS NW + Cy sin nw 
yo(n)  \ _«, sinnw + cecosnw] ` 
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Given the initial values yi(0) = yio and y2(0) = yao, one may obtain 
cı = Yio and cg = yao. The solution is denoted by 
Yı (n) = lài I" (y10 cos NW + Y20 sin nw), 


yo(n) = |Ai|"(—yr0 sin nw + y20 cos nw). 


If we let cosy = y10/ro and siny = y20/ro, where ro = (Yo + v30); we 
have yı(n) = |A1 |” ro cos(nw — y) and yo(n) = —|Ai|"ro sin(nw — y). Using 
polar coordinates we may now write the solution as 


r(n) = rolAi|”, O(n) = —(nw — 4). 


If |Ai| < 1, we have an asymptotically stable focus, as illustrated in Figure 
4.15. If |Ai| > 1, we find an unstable focus, as shown in Figure 4.16. When 
|Ai| = 1, we obtain a center where orbits are circles with radii (Figure 4.17) 


To = / Yio + Y3o- 


Y2 


ete | 


ae, i 


FIGURE 4.15. |A| < 1, asymptotically stable focus. 


Yo 


oe 


FIGURE 4.16. |A| > 1, unstable focus. 
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yı 


FIGURE 4.17. |A| = 1, center (stable). 


Using (4.4.3) one may sketch the corresponding phase space portraits in 
the 2122-plane for the system of equations (4.4.1). The following example 
illustrates this method. 


Example 4.18. Sketch the phase space portrait of the system 


1 1 
x(n+1)=Aza(n), where A= ; 
0.25 1 


Solution The eigenvalues of A are Ay = 1.5 and A2 = $3 the corresponding 
eigenvectors are £; = (7) and é = (7,), respectively. Thus 


4 15 0 2: 2 
P~ AP =J= , where P= 
0 0.5 1 -1 


Figure 4.18 shows the phase space portrait for y(n+1) = Jy(n). To find the 
corresponding phase space portrait of our problem, we let x(n) = Py(n). 
We define the relationship between the y;—y2 system and the x1—ax2 system 
by noticing that ($) in the y:-yo system corresponds to P(5) = ({) in 
the x;—r2 system, and (?) in the yı-y2 system corresponds to the point 
PO = (2) in the x1—x2 system. The y1-axis is rotated by ĝı = tan™1(0.5) 
to the z-axis, and the yz-axis is rotated by 02 = tan~'(—0.5) to the z2-axis. 
Furthermore, the initial point 


(mm) = 


for the canonical system corresponds to the initial point 


The phase space portrait of our system is shown in Figure 4.19. Basically, 
the axis xı is c€, = 9), c E€ R, and the axis z2 is c2 = (2c ER. 
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Jy 
“<i 


A 


FIGURE 4.18. Canonical saddle. 


N x 
<< 


FIGURE 4.19. Actual saddle. 


Example 4.19. Sketch the phase space portrait of the system x(n + 1) = 
Ax(n) with 


Solution The eigenvalues of A are Ay = 1+ V/3i and Ay = 1 — V3i. The 
eigenvector corresponding to A, is 


(9-3-0) 
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If we let 
3 0 
P= v3 ; 
0 1 
then 
1 v3 
P'AP =J= ; 
-v3 1 
which is in the canonical form (4.4.2) (c). Hence, the solution of y(n +1) = 
Jy(n) is 
r(n) = rolAi|” = y Yio + Yio(2)" 
and 
O(n) = a — nw, 
where 
a = tan”! (=) : w = tan”! (v3) = 5 
Y10 3 
Figure 4.20 depicts the orbit of (+. 0). The solution is given by r(n) = 


p (2)” = 2"~4, O(n) = 7 — (nz) /3. The corresponding orbit in the original 


system has an initial point 


_ (v3 o (-1/16\ _ (v3/16 
eS i yk T 


and is depicted in Figure 4.21. Notice that no axis rotation has occurred 
here. 


FIGURE 4.20. Canonical unstable focus. 
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FIGURE 4.21. Actual unstable focus. 


Exercises 4.4 


1. Sketch the phase space diagram and determine the stability of the 
equation x(n + 1) = Aa(n), where A is given by 


05 0 05 0 
(a) (o a (b) e ) 

21 -05 1 
(c) é a (a) ( 0 


2. Sketch the phase space diagram and determine the stability of the 
system a(n + 1) = Ax(n), where A is given by 


0 2 0.6 —0.5 
‘ b ; 
(a) e (0) a 0.6 
1 0.5 06 0.8 
(c) . ) 
—0.5 1 —0.8 0.6 
In Problems 3 through 6, sketch the phase space diagram and determine 
the stability of the system x(n + 1) = Az(n). 


1 1 
2 a=( ) 
-1 3 
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7. If the eigenvalues of a real 2 x 2 matrix A are a+ iG, a — iG, show 
that the Jordan canonical form of A is 


(5 3) 


4.5 Liapunov’s Direct, or Second, Method 


In his famous memoir, published in 1892, the Russian mathematician A.M. 
Liapunov introduced a new method for investigating the stability of non- 
linear differential equations. This method, known as Liapunov’s direct 
method, allows one to investigate the qualitative nature of solutions with- 
out actually determining the solutions themselves. Therefore, we regard 
it as one of the major tools in stability theory. The method hinges upon 
finding certain real-valued functions, which are named after Liapunov. The 
major drawback in the direct method, however, lies in determining the 
appropriate Liapunov function for a given equation. 

In this section we adapt Liapunov’s direct method to difference 
equations. We begin our study with the autonomous difference equation 


x(n +1) = f(x(n)), (4.5.1) 


where f : G — R*,G c R*, is continuous. We assume that x* is an 
equilibrium point of (4.5.1), that is, f(x*) = x*. 

Let V : R? > R be defined as a real-valued function. The variation of V 
relative to (4.5.1) would then be defined as 


AV (2) = V(f(2)) — V (2) 
and 
AV (z(n)) = V (f(a(n))) — V(z(n)) = V(a(n + 1)) — V (z(n)). 


Notice that if AV (x) < 0, then V is nonincreasing along solutions of (4.5.1). 
The function V is said to be a Liapunov function on a subset H of R° if: 


(i) V is continuous on H, and 
(ii) AV(a) < 0, whenever x and f(x) belong to H. 


Let B(x, y) denote the open ball in R* of radius y and center x defined 
by B(x, 7) = {y € R*||ly — z|| < y}. For the sake of brevity, B(0,y) will 
henceforth be denoted by B(y). We say that the real-valued function V is 
positive definite at x* if: 

(i) V(a*) = 0, and 


(ii) V(x) > 0 for all x € Ba*,y), x # x*, for some y > 0. 
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V (x , Xs) 


X2 
X4 


FIGURE 4.22. A quadratic Liapunov function. 


We now present to the reader an informal geometric discussion of the first 
Liapunov stability theorem. For simplicity, we will assume that our system 
is planar with x* = 0 as the equilibrium point. Suppose that (4.5.1) has 
a positive definite Liapunov function V defined on B(7). Figure 4.22 then 
illustrates the graph of V in a three-dimensional coordinate system, while 
Figure 4.23 gives the level curves V (z1, £2) = c of V in the plane. If we now 
let € > 0, B(e) then contains one of the level curves of V, say V(x) = č2. 
The level curve V(x) = č contains the ball B(0) for some 6 with 0 < ô < e. 
If a solution x(n, 0, xo) starts at xo € B(d), then V (zo) < č2. Since AV < 0, 
V is a monotonic nonincreasing function along solutions of (4.5.1). Hence, 
V(a(n)) < V(ao) < č for all n > 0. Thus, the solution æ(n,0, zo) will 
stay forever in the ball B(e). Consequently, the zero solution is stable. The 
above argument contains the essence of the proof of the first Liapunov 
stability theorem. 


Theorem 4.20 (Liapunov Stability Theorem). Jf V is a Liapunov 
function for (4.5.1) in a neighborhood H of the equilibrium point «*, and 
V is positive definite with respect to x*, then x* is stable. If, in addition, 
AV (a) < 0 whenever x, f(x) € H and x 4 x*, then x* is asymptotically 
stable. Moreover, if G = H = R* and 


V(x) > co as |la|| > co, (4.5.2) 
then x* is globally asymptotically stable. 


PROOF. Choose a; > 0 such that B(x*,a1) C GN H. Since f is continu- 
ous, there is a2 > 0 such that if x € Bx*,az), then f(x) € B(a*,a,). Let 
0 < € < ae be given. Define y(e) = min{V(a)|e < ||” — 2*|| < ay}. By the 
Intermediate Value Theorem, there exists 0 < 6 < £ such that V(x) < w(e) 
whenever ||xz — 2*|| < ô. 
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FIGURE 4.23. Level curves. 


Realize now that if x) E€ B(a*, 6), then a(n) € B(a*,e) for all n > 0. 
This claim is true because, if not, there exist zo E€ B(x*, ð) and a positive 
integer m such that x(r) € B(a*,¢) for 1 < r < mand a(m+1) ¢ B(a*,¢). 
Since z(m) € B(a*,e) C B(a*, ag), it follows that z(m + 1) € B(a*,az). 
Consequently, V(a(m-+1)) > w(e). However, V(a(m+1)) < +--+ < V(x) < 
w(e), and we thus have a contradiction. This establishes stability. 

To prove asymptotic stability, assume that zo € B(x*, ô). Then a(n) € 
B(x*,£) holds true for all n > 0. If {z(n)} does not converge to x*, then 
it has a subsequence {a(n;)} that converges to y € R®. Let E C B(£*, a1) 
be an open neighborhood of y with x* ¢ E. Having already defined on Æ 
the function h(x) = V(f(<))/V (x), we may consider h as well-defined and 
continuous, and h(x) < 1 for all x € E. Now, if n € (h(y),1), then there 
exists a > 0 such that 2 € B(y, a) implies h(x) < n. Thus, for sufficiently 
large nj, 


V (f(a(na))) < nV (a(n: = 1)) < nV (a(n: = 2)) < -++ < n™ V (xo). 
Hence, 


im V (x(n;)) = 0. 
But since limy,-+00 V (x(ni)) = V (y), this statement implies that V(y) = 0 
and, consequently, y = x*. 

To prove the global asymptotic stability, it suffices to show that all solu- 
tions are bounded and then repeat the above argument. Begin by assuming 
that there exists an unbounded solution x(n), and then some subsequence 
{x(ni)} > œ as nj —> oo. By condition (4.5.2), this assumption im- 
plies that V (x(n;)) + co as n; — oo, which is a contradiction, since 
V(ao) > V (a(n;)) for all i. This concludes the proof. 
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The result on boundedness has its own independent importance, so we 
give it its due respect by stating it here as a separate theorem. 


Theorem 4.21. If V is a Liapunov function on the set {x € R*|||x|| > a} 
for some a > 0, and if condition (4.5.2) holds, then all solutions of (4.5.1) 
are bounded. 


PROOF. (Exercises 4.5, Problem 7.) 


Example 4.22. Consider the following second-order difference equation: 


aa(n — 1) 
t1)= : >0. 
«(n+ 1) 1+ par) B 
This equation is often called an equation with delay. There are three 
equilibrium points, namely, x* = 0 and 


(a—1) 
b 


if a > 1. Let us first change the equation into a system by letting yı (n) = 
x(n — 1) and y2(n) = x(n). Then we obtain the system 


tT =T 


yi(n +1) = y2(n), 
1)= ayı (n) i 
1 + By3(n) 
Consider the stability of the equilibrium point (0,0). Our first choice of a 


Liapunov function will be V (y1, y2) = y? + y2. This is clearly continuous 
and positive definite on R?: 


AV (y(n), yo(n)) = y? (n + 1) + y2(n + 1) — yi (n) — y3(n). 


yo(n 


Thus, 
a? 2 2 2 

AV (m0) C) = (agp 1) O < (a? = Dae). (45.3) 
If a? < 1, then AV < 0. In this case x* = 0 would be the only equilib- 
rium point, and by Theorem 4.20, the origin is stable (Figure 4.24). Since 
lim|jz|-+o V(x) = œ, Theorem 4.21 implies that all solutions are bounded. 
Since AV = 0 for all points on the y2-axis, Theorem 4.20 fails to determine 
asymptotic stability for this equation. 

This situation is typical in most of the problems encountered in applica- 
tions in science and engineering. Therefore, a finer and more precise analysis 
is required. This need leads us to LaSalle’s invariance principle, which will 
be presented shortly. 

To prepare for the introduction of our major theorem, we ought to 
familiarize ourselves with some vital terminology: 


(i) For a subset G C R*, x is a limit point of G if there exists a sequence 
{z;} in G with z; > x as i > o. 
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(ii) The closure G of G is defined to be the union of G and all of its limit 
points. 


(iii) After considering (4.5.1), the positive orbit O*(a9) is defined as 
Ot (xo) = {a(n,0,29)|n € Zt}. Since we will only deal with posi- 
tive orbits, O* (x) will be denoted by O(x). We will denote OT (xg) by 
O(20). 


(iv) The limit set Q(x), also referred to as the positive limit set, of xo is the 
set of all positive limit points of xg. Thus, Q(xo) = {y € R*|x(n;) > y 
as ni —> oo for some subsequence {n;} of ZT}. 


(v) A set A is positively invariant if O(a) C A for every zo E€ A. One 
may easily show that both O(a) and Q (xo) are (positively) invariant. 


The nagging question still persists as to whether or not Q(2o) is 
nonempty for a given xo € RF. The next lemma satisfies that question. 


Theorem 4.23. Let xo € R" and let Q(x) be its limit set in (4.5.1). 
Then the following statements hold true: 


(i) Azo) = A Ue) = A U {a(n} 


i=0 n=i i=0 n=i 

(ii) If f7 (x0) = yo, j E€ Z*, then Q(yo) = Q(x) - 

(iii) O(a) is closed and invariant. 

(iv) If the orbit O(xo) is bounded, then Q(xo) is nonempty and bounded. 

PROOF. 

(i) Let y € Q(x). Then f(x) > y as n; — oo. Now for each i, there 
exists a positive integer N; such that f" (xo) € Uo) for all 


nj > Ni. Thus y € (U {f"(xo)} for every N and, consequently, y € 


OL. =) 
NM U{f"(xo)}. This proves one inclusion and, conversely, let y € 


i=0 n=i 

N U{f"(xo)}. Then for each i, y € U {f"(xo)}. Thus for each i 
i=0n=i n=i 

there exists f™ (xo) € B,(xo), with nı < ng < ng <+- and n; > œ 


as i + oo. Clearly, f" (xo) > y as ny — œ and hence y € Q(z0o). 


(ii) The proof of (ii) is left to the reader as Problem 5. 


(iii) Since the closure of a set is closed, U {f”(xo)} is closed. Now that 
Q(zxo) is closed follows from the fact that the intersection of closed sets 
is closed. 
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To show that Q(xo) is invariant, let y E€ Q(x). Then f% (xo) > y 
as n; — oo. Since f is continuous, it follows that f™+1(2 9) = f 
(f™ (ao) + f(y)). Hence f(y) € Q(xo) and Q(z) is thus invariant. 


(iv) This is left to the reader as Problem 6. 


Let V be a positive Liapunov function on a subset G of R*. Define 
E = {x € G|AV(z) = 0}. 


Let M be the maximal invariant subset of E, that is, define M as the union 
of all invariant subsets of FE. 


Theorem 4.24 (LaSalle’s Invariance Principle) [88]. Suppose that 
V is a positive definite Liapunov function for (4.5.1) in G C R*. Then for 
each bounded solution x(n) of (4.5.1) that remains in G for all n € Z*, 
there exists a number c such that x(n) +> MNV~1(c) as n > œ. 


PROOF. Let x(n) be a bounded solution of (4.5.1) with x(0) = ao and 
such that x(n) is bounded and remains in G. Then, by Theorem 4.23, 
o # Yao) C G. Thus, if y € Q(xo), then x(ni) > y asn; > œ for 
some subsequence n; € Zt. Since V(x(n)) is nonincreasing and bounded 
below, limp. V(#(n)) = c for some number c. By the continuity of V, 
it follows that V(x(n;)) > V(y) as n; => co, and thus V(y) = c. This 
implies that V(Q(ao)) = c and, consequently, Q(a9) C V~*(c). Moreover, 
AV(y) = 0 for every y € Q(ao). This implies that Q(zo) C E. But, since 
Q(x) is (positively) invariant, Q(xo) C M. Therefore, x(n) > Q(ao) C 
MnV~-l(c) asn— oo. 


Example 4.22 revisited. Let us reexamine Example 4.22 in light of 
LaSalle’s invariance principle. We will consider three cases: 


Case 1. a? = 1. The set FE consists of all the points on the z- and y- 
axes. We have two subcases to consider. Subcase (i): a = 1. If yi(0) = a 
and y2(0) = 0, then yı(1) = 0 and y2(1) = a, and yi (2) = a, yo(2) = 0. 
Therefore, any solution starting on either axis is of period 2, and M = E. 
Subcase (ii): a = —1. Then 0*(a,0) = {(a,0), (0, —a), (—a, 0), (0, a)}. Thus 
any solution starting on either axis is of period 4, and M = E again. Hence 
all solutions converge to (a,0), (—a,0), (0,a), or (0, —a). Clearly, the zero 
solution is not asymptotically stable. 


Case 2. Because a? < 1, E is equal to the y-axis and M = {(0,0)}. Thus, 
all solutions converge to the origin. Hence the origin is globally asymptoti- 
cally stable. Figure 4.24 depicts the phase portrait for a = 0.5. Notice the 
difference in the way solutions in quadrants I and III begin, compared to 
the way the solutions in quadrants II and IV commence. 


Case 3. a? > 1. In this case, LaSalle’s invariance principle does not aid us 
in determining the stability of the solution. In other words, the stability is 
indeterminable. 
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(-0.9 , 0.8) A (0.9 , 0.8) 


(-0.9 , -0.8) 


FIGURE 4.24. A globally asymptotically stable equilibrium. 


Sometimes, we may simplify the difference equation by applying a simple 
basic transformation to the system. For instance, one might translate the 
system into polar coordinates (r,@), where x, = rcos@, x2 = rsin@. The 
following example demonstrates the effectiveness of this method. 


Example 4.25. Consider the difference system 
zı(n +1) = z1 (n) — 23(n), 
x2(n + 1) = 2a, (n)za(n). 


Let xı(n) = r(n) cos (n) and x(n) = r(n) sin O(n). 
Then 


r(n +1) cos @(n + 1) = r?(n) cos? O(n) — r° (n) sin? O(n) 
= r?(n) cos 20(n), (4.5.4) 
and 
r(n+1)sin@(n +1) = 2r? sin O(n) cos A(n) 
= r?(n) sin 20(n). (4.5.5) 
Dividing (4.5.4) by (4.5.5), we get 
O(n +1) = 20(n). 
Substituting this into (4.5.4), we obtain 
r(nt1) =r?(n). 


We may write this solution as r(n) = [r(0)]?” and @(n) = 2”6(0). 
The equilibrium points are (0,0) and (1,0). 
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FIGURE 4.25. Unstable limit cycle. Three initial values (0.6,0.8), (0.6,0.81), 
(0.6, 0.79). 


For r(0) < 1, limpo 7r(n) = 0. Thus solutions starting inside the unit 
disk spiral toward the origin. Consequently, the origin is asymptotically 
stable (not globally), as shown in Figure 4.25. 

For r(0) > 1, we have limp... r(m) = œ, and hence solutions that start 
outside the unit disk spiral away from the unit circle to oo. This occurrence 
makes the equilibrium point (1,0) unstable. 

For r(0) = 1,r(n) = 1, for all n > 0. Therefore, the circle is an 
invariant set, with very complicated dynamics. For instance, the solu- 
tion starting at (1,4) will reach the equilibrium point (1,0) in three 
iterations: (1, 4) , (1, 4) (1,7), (1,0). However, the solution that starts at 
(1, 2) is a 2-cycle. In general, (1,0) is periodic, with period m, if and 
only if 2”0 = 0 + 2k for some integer k, i.e., if and only if 0 = 


en k= OD Foe m 36 = HEE E, E 
For m = TE 50 15? 3° 5° 15? 15 
Notice here that @ is essentially the (2™ — 1)th root of 1. Hence, the set 


of periodic points (1,0) densely fills the unit circle (Exercises 4.5, Problem 
8). Furthermore, for every m = 1,2,..., there is a periodic point on the 
unit circle of that period m. 

Now, if 0 = az, a irrational, then obviously, 6 4 (2k7)/2™ — 1 for any 
m, and thus any solution starting at (1,a7) cannot be periodic. However, 
its orbit is dense within the unit circle, that is, O(x) is the unit circle 
(Exercises 4.5, Problem 8). 


Sometimes, some simple intuitive observations make it much easier to 
show that an equilibrium point is not asymptotically stable. The following 
example illustrates this remark. 
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Example 4.26. Consider the planar systems 
ri(n +1) = 2g2(n) — 2x0(n)x?(n), 


r2(n+1)= 5ei(n) + ay(n)a3(n). 


We find three equilibrium points: 


1 1 1 1 
od (wa) Ca) 
Let us consider the stability of (0,0). If V (£1, £2) = x? + 4x3, then 
AV (a(n), a9(n)) = 403(n) — 823 (n)a}(n) + 4r3(n)xi(n) + 27 (n) 
+ 4a} (n)a3(n) + 4a} (n)x3(n) — ri(n) — 4x3(n) 
= 4x} (n)x3(n)[x7(n) + 23(n) — 1]. 
If z? + #3 < 1, then AV (z1, £2) < 0. 
For any real number a, the solution with an initial value of £o = (o) 


is periodic with period 2 and with orbit {Gr (a92) r and a solution with 


an initial value of x9 = (°) is also periodic with period 2. Hence, the zero 
solution cannot be asymptotically stable. However, it is stable according 
to Theorem 4.20. (Figure 4.26 depicts the phase space portrait near the 
origin.) 


We now turn our attention to the question of instability. We are inter- 
ested in finding conditions on Liapunov functions under which the zero 
solution is unstable. Here is a widely used theorem in this area. 


FIGURE 4.26. Stable equilibrium. 


4.5 Liapunov’s Direct, or Second, Method 213 


Theorem 4.27. If AV is positive definite in a neighborhood of the origin 
and there exists a sequence a; > 0 with V(a;) > 0, then the zero solution 
of (4.5.1) is unstable. 


PROOF. Let AV(x) > 0 for x € B(n),x 4 0,V(0) = 0. We will prove 
Theorem 4.27 by contradiction, first assuming that the zero solution is 
stable, in which case, for € < 7, there would exist ô < € such that ||zq|| < 6 
implies ||z(n,0,20)|| <e,n € Zt. 

Since a; —> 0, pick £o = a; for some j with AV (xo) > 0 and ||xo|| < ô. 
Hence 0(a9) C B(e) C B(n) is closed and bounded (compact). Since 
its domain is compact, V(a(n)) is also compact, and therefore bounded 
above. Since V(æ(n)) is also increasing, it follows that V(a(n)) > c. Fol- 
lowing the proof of LaSalle’s invariance principle, it is easy to see that 
limno x(n) = 0. Therefore, we would be led to believe that 0 < V(ao) < 
limpo V(a(n)) = 0. This statement is infeasible—so the zero solution 
cannot be stable, as we first assumed. The zero solution of (4.5.1) is thus 
unstable. 

The conclusion of the theorem also holds if AV is negative definite and 
V (ai) <0. 


Example 4.28. Consider the systems 


xi(n+1) = 4ro(n) — 2zə(n)zî (n), 


gzə(n+ 1) = 


Let V (x1, £2) = £? + 16x3. Then 

AV (z1(n), za(n)) = 32? (n) + 16r? (n)zå(n) + 4rfz? >0 if zı(n) #0. 
Hence, by Theorem 4.27 the zero solution is unstable. 
Example 4.29. First, contemplate the systems 


xıln +1) = zi (n) + z2(n) + z? (n), (4.5.6) 


zə(n +1) = z2(n). 


Notice that (0,0) is an equilibrium of the systems. Its linear component is 
denoted by x(n + 1) = Ax(n), where 


1 
a={ al 
0 1 


and thus p(A) = 1. Let V(x) = xı + z2 be a Liapunov function. Then 
AV[a(n)] = x? +3 >0, if (x1, x2) 4 (0,0). 


Theorem 4.27 implies that the zero solution of system (4.5.6) is unstable. 
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Let us now ponder system (4.5.7), with the same linear component as 
system (4.5.6): 


a(n +1) = 2r(n) — 2}(n)o3(n), 
to(n + 1) = z2(n). (4.5.8) 
We let V(x) = x? + 23 be a Liapunov function for system (4.5.7). Then 
AV [x(n)] = x7(n)x3(n) [-2 + a7 (n)x3(n)] . 


Hence, AV (x) < 0 if xtx3 < 2. It follows from Theorem 4.27 that the zero 
solution of system (4.5.7) is stable. 


We conclude from this discussion that if p(A) = 1, then the zero solution 
of the nonlinear equation may be either stable or unstable, thus proving 
part (i) of Theorem 4.38. 

We conclude this section with a brief discussion of Liapunov functions for 
linear autonomous systems. In Section 4.3, we noticed that the condition 
for asymptotic stability of the difference equation (4.3.6) is that p(A) < 1. 
This condition requires the computation of the eigenvalues of A. Using 
the second method of Liapunov, such computation is unnecessary. Before 
introducing Liapunov’s method, however, we need to recall the definition 
of a positive definite matrix. Consider the quadratic form V(x) fora k x k 
real symmetric matrix B = (b;;): 


k k 
V(x) =a? Ba = >D 5 bij£iTj. 


i=1 j=1 
A matrix B is said to be positive definite if V(x) is positive definite. 
Sylvester’s criterion is the simplest test for positive definiteness of a matrix. 
It merely notes that a real symmetric matrix B is positive definite if and 
only if the determinants of its leading principal minors are positive, i.e., if 
and only if 
bir dig bis 
> 0, b21 b22 b23 >0,...,det B > 0. 


b31 b32 b33 


bii bie 


by, > 0, 
ye biz b22 


The leading principal minors of matrix B are B itself and the minors 
obtained by removing successively the last row and the last column. For 
instance, the leading principal minors of 


3 2 0 
B=|2 5 -1 
0 —1i 1 


are 
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all of which have positive determinants. Hence, B is positive definite. Notice 
that, for x = (x1, £2, £3), 


V(x) = z" Br = 3x? + 5x2 + x2 + 42122 — 2x73 > 0 


for all x # 0, and V(0) = 0. 
On the other hand, given 


V(x) = ax? + bx + cx? + d£1£2 + eri 73 + frezs, 


one may write 


V(x) = xz! Ba, 
where 
a d/2 e/2 
B=|d/2 b f/2 
e/2 f/2 c 


Hence V is positive definite if and only if B is. We now make a useful 
observation. Note that if B is a positive definite symmetric matrix, then 
all eigenvalues of B are positive (Exercises 4.5, Problem 14). Furthermore, 
if Ay, A2,..., Ax are the eigenvalues of B with 

Amin = min{|A;||1 <i < k}, 

Amax = P(A) = max{|Aj||1 < i < k}, 


then 
Aminllæll? SVC) < Amaxllæll?, (4.5.9) 


for all x € R*, where V(x) = x7 Bz, and ||.|| is the Euclidean norm 
(Exercises 4.5, Problem 15). 

If B is a positive definite matrix, we let V(x) = x7? Br be a Liapunov 
function of (4.3.6). Then, relative to (4.3.6), 


AV (z(n)) = #7 (n) AT BAz(n) — a7 (n)B(n) 
= xT (AT BA — B)z. (4.5.10) 
Thus AV < 0 if and only if 
ATBA-B=-C (4.5.11) 


for some positive definite matrix C. Equation (4.5.11) is labeled the Li- 
apunov equation of the system of equations (4.3.6). The above argument 
establishes a sufficient condition for the asymptotic stability of the zero 
solution of (4.3.6). It is also a necessary and vital condition, as may be 
seen by the following result. 
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Theorem 4.30. The zero solution of (4.3.6) is asymptotically stable if 
and only if for every positive definite symmetric matriz C, (4.5.11) has a 
unique solution B that is also symmetric and positive definite. 


PROOF. Assume that the zero solution of (4.3.6) is asymptotically stable. 
Let C be a positive definite symmetric matrix. We will show that the 
Liapunov equation (4.5.11) has a unique solution B. Multiply (4.5.11) from 
the left by (AT)” and from the right by A” to obtain 


(AT) Batt _ (AT)" BA" = {AT CA". 


Hence 
. T\r+1 r+l Tyr eae E Tyr r 
e HBA (AT)"BA"| = ae EA 
and 
. _ T\n+1 n+1] _ Tyr r 
jim [B-(A?)"*1BA ie roa (4.5.12) 


Using Theorem 4.13, part (ii), we conclude that p(A) < 1 and, consequently, 
p(AT) < 1. This implies that lim,.(A?)"*+BA"*t? = 0. Thus formula 
(4.5.12) yields 


B=) (A7)'CA’. (4.5.13) 

r=0 
It is straightforward to prove that formula (4.5.13) gives a solution of 
(4.5.11) (Exercises 4.5, Problem 16). But since there is a norm such that 
| A? || < 1 and ||A]| < 1, it may be shown that the series in formula 
(4.5.13) converges (Exercises 4.5, Problem 16). It is easy to verify that 
B is symmetric and positive definite (Exercises 4.5, Problem 16). 


Remark: Note that from the proof preceding the statement of Theorem 
4.30, the zero solution of (4.3.6) is asymptotically stable if (4.5.11) has 
a unique, symmetric, and positive definite matrix B for some (not all) 
positive definite matrices C. Indeed, one may allow C to be the identity 
matrix I. In this case a solution of (4.5.11) is given by 


B= (ATYA. (4.5.14) 
r=0 
Corollary 4.31. If p(A) > 1, then there exists a real symmetric matrix B 


that is not positive semidefinite such that (4.5.11) holds for some positive 
definite matris C. 


PROOF. This follows from Theorem 4.30 and is left to the reader as 
Problem 17 of Exercises 4.5. 
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Exercises 4.5 
1. Consider the planar system 
vi(n +1) =aa(n)/[1+a%(n)],  xə(n +1) = zı (n)/[1 + 23(n)]. 
Find the equilibrium points and determine their stability. 


2. Consider the planar system 


xı(n +1) = gi(x1(n), t2(n)), 


x(n + 1) = go(x1(n), x2(n)), 


with gi(0,0) = go(0,0) = 0 and gi (#1, £2)g2(£1, £2) > 1122, for every 
point x = (x1, £2) in a neighborhood of the origin. Show that the origin 
is unstable. 


*3. Consider the system 
xi(n +1) = axe(n)/[1 + z? (n), xo(n +1) = bzi (n)/[1 + 23(n)]. 
(i) Find conditions on a and b under which: 
(a) the zero solution is stable, and 
(b) the zero solution is asymptotically stable. 
(ii) Find the attractor when a? = b? = 1. 
4. Prove that the zero solution of 


a(n + 1) = z2(n) — z2(n)[zi (n) + z3(n)], 


x(n + 1) = a(n) — zı (n)[z3 (n) + 23(n)], 


is asymptotically stable. 
. Prove Theorem 4.23, part (ii). 
. Prove Theorem 4.23, part (iv). 
. Prove Theorem 4.21. 


ao N DD oO 


. In Example 4.25: 


(a) Show that the orbit starting at the point (1,a7), where a is any 
irrational number, is dense on the unit circle. 


(b) Show that the set of periodic points (1,0) is dense on the unit 
circle. 
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*9. Suppose that: 


(i) V is a Liapunov function of system equation (4.5.1) on R*, 
(ii) Ga = {x|V (x) < A} is bounded for each A, and 


(iii) M is closed and bounded (where M is the maximal invariant set 
in E). 


(a) Prove that M is a global attractor, i.e., Q(xo) C M for all 
Lo €E R*. 


(b) Suppose that M = {0}. Verify that the origin is globally 
asymptotically stable. 


10. Show that the sets G defined in the preceding problem are bounded 
if V(x) > œ as ||| > oo. 


*11. (Project). Suppose that V : R* — R is a continuous function 
with A?V(z(n)) > 0 for a(n) # 0, where a(n) is a solution of 
(4.5.1). Prove that for any xo € R*, either x(n, xo) is unbounded or 
limno Z(n, xo) = 0. 


*12. (Project). Wade through Problem 11 again, after replacing the 
condition A?V(a(n)) > 0 by A?V(a(n)) < 0. 


eR 


3. Contemplate the planar system 


a(n +1) = y(n), 
y(n + 1) = a(n) + f(a(n)). 


If A[y(n)f(a(n))] > 0 for all n € Z*, prove that the solutions are 
either unbounded or tend to the origin. 


Be 


4. Prove that if B is a positive definite symmetric matrix, then all its 
eigenvalues are positive. 


15. Let B be a positive definite symmetric matrix with eigenvalues 1 < 
Ag < +++ < Ap. For V(x) = x? Bz, show that Allel? < V(x) < Azllæll2 
for all x € R*. 


16. (a) Show that the matrix B = Ð% (AT)"CA" is symmetric and 
positive definite if || A|| < 1 and C is a positive definite symmetric 
matrix. 


(b) Show that the matrix B in formula (4.5.13) is a solution of 
(4.5.11). 


17. Prove Corollary 4.31. 
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4.6 Stability by Linear Approximation 


The linearization method is the oldest method in stability theory. Scien- 
tists and engineers frequently use this method in the design and analysis 
of control systems and feedback devices. The mathematicians Liapunov 
and Perron originated the linearization method, each with his own unique 
approach, in their work with the stability theory of differential equations. 
In this section we adapt Perron’s approach to our study of the nonlinear 
systems of difference equations 


y(n + 1) = A(n)y(n) + g(n, y(n)) (4.6.1) 
using their linear component 
z(n+1) = A(n)z(n), (4.6.2) 


where A(n) isa k x k matrix for all n € Z* and g : Z+ xG > R*,G CR’, is 
a continuous function. One may perceive system (4.6.1) as a perturbation of 
system (4.6.2). The function g(n, y(n)) represents the perturbation due to 
noise, inaccuracy in measurements, or other outside disturbances. System 
(4.6.1) may arise from the linearization of nonlinear equations of the form 


x(n +1) = f(n, z(n)), (4.6.3) 
where f : Z+xG > R*,G c R*, is continuously differentiable at an equilib- 
rium point y* (i.e., 2 |y* exists and is continuous on an open neighborhood 


of y* for 1 < i < k). We now describe the linearization method applied to 
system (4.6.3). Let us write f = (fi, fo,..., fe)”. The 


a fi(n, 0) Of (n, 0) a Of1(n, 0) 
Oy Oye OYK 
O f2(n, 0) ð f2(n, 0) cae O fo(n, 0) 
Oy |y=o Oy ; 
Oy Oye OYK 
For simplicity, Ofna") is denoted by Df(n,x*). Letting 
y(n) = x(n) — a* (4.6.4) 


in (4.6.3) yields 
y(n +1) = f(n, y(n) + 2*) — 2” 
z ĉin, x" )y(n) + g(n, y(n)) 


where g(n,y(n)) = f(n, y(n) + 2*) — «* — 52 (n, x*)y(n). 
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If we let A(n) = Sf (n, x*), then we obtain (4.6.1). From the assumptions 
on f, we conclude that g(n,y) = o(|lyl|) as ||y|| — 0. This means, given 
E > 0, there exists ô > 0 such that ||g(n, y)|| < e||y|] whenever ||y|| <6, for 
all n € Zt. 

Notice that when x* = 0, we have 


g(n, y(n)) = f(n, y(n)) — DF (n, 0)y(n) 
= f(n, y(n)) — A(n)y(n). 
An important special case of system (4.6.3) is the autonomous system 
y(n +1) = f(y(n)), (4.6.5) 


which may be written as 


y(n +1) = Ay(n) + g(y(n)), (4.6.6) 


where A = f’(0) is the Jacobian matrix of f at 0, and g(y) = f(y) — Ay. 
Since f is differentiable at 0, it follows that g(y) = o(y) as |ly|| > 0. 
Equivalently, 


lOl _ 4 


lim 
ivliso yll 


Remarks: 


(a) Observe that whether the linearization is about a nontrivial equilib- 
rium point x* Æ 0 or a trivial equilibrium x* = 0, g(n, 0) = 0 (g(0) = 0) 
for all n € Z+. Hence the zero solution of (4.6.1) corresponds to the 
equilibrium point x* that we linearize about. 


(b) If one wishes to study a nontrivial equilibrium point «* 4 0, then 
by virtue of (a), we have two options. The first option is to linearize 
about x*. The second option is to make the change of variable y(n) = 
x(n) — «* as in (4.6.4). In the new system, y* = 0 corresponds to x*. 
Then we linearize the new system about y* = 0. The latter option is 
simple in computation as it is usually used if x* is given explicitly. 
The former option is used normally if «* is given implicitly or we have 
multiequilibria. 


Before commencing our stability analysis we must consider a simple but 
important lemma. This lemma is the discrete analogue of the so-called 
Gronwall inequality, which is used, along with its variations, extensively in 
differential equations. 


Lemma 4.32 (Discrete Gronwall Inequality). Let z(n) and h(n) 
be two sequences of real numbers, n > no > 0 and h(n) > 0. If 


z(n) < M |z(no) + AG) 


J=no 
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for some M > 0, then 


z(n) < z(no) II (1+ Mh(j)], n> no, (4.6.7) 
z(n) < z(no) exp X Mh(j)|, n> no. (4.6.8) 

PROOF. Let 
u(n) = M [umo + E Mu, ulno) = 00). (46.9) 


Since h(j) > 0 for all j > no, it follows that z(n) < u(n) for all n > no. 
From (4.6.9) we have u(n + 1) — u(n) = Mh(n)u(n), or u(n + 1) = [1 + 
) 


Mh(n)]u(n). By formula (1.2.3) we obtain 
u(n) = JI B+ Mhu). 


This proves formula (4.6.7). The conclusion of formula (4.6.8) follows by 
noting that 1+ Mh(j) < exp(MA(j)). 


Theorem 4.33. Assume that g(n,y) = o(|ly||) uniformly as |ly|| > 0. 
If the zero solution of the linear system (4.6.2) is uniformly asymptotically 
stable, then the zero solution of the nonlinear system (4.6.1) is exponentially 
stable. 


PROOF. From (4.3.5) it follows that ||®(n,m)|| < Mn-™,n > m > no, 
for some M > 1 and 7 € (0,1). By the variation of constants formula 
(3.2.12), the solution of (4.6.6) is given by 


y(n, no, Yo) = O(n, no) Yo + yo n, j + 1)g(j, y(9)). 


j=no 


Thus 


lyel] < Mn" lyol] + Mn 5 a IgG, y) (4.6.10) 


Jj=no 


For a given £ > 0 there is 6 > 0 such that ||g(j,y)|| < ellyl| whenever 
\|y|| < 6. So as long as ||y(7)|| < 6, (4.6.10) becomes 


n—1 


nly M (rly + $ eniu] - (4.6.11) 


J=no 
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Letting z(n) = n~™||y(n)|| and then applying the Gronwall inequality 
(4.6.7), one obtains 


n-1 
ally) <n" uol, [E+ en. 
j=no 
Thus, 
lu] < Ilyoll(n + eM) E=». (4.6.12) 


Choose e < (1 — ņn)/M. Then n+ eM < 1. Thus ||y(n)|| < ||yo|| < 6 for all 
n > no > 0. Therefore, formula (4.6.11) holds and, consequently, by virtue 
of formula (4.6.12), we obtain exponential stability. 


Corollary 4.34. If p(A) < 1, then the zero solution of (4.6.6) is 
exponentially stable. 


Proor. Using Theorem 4.13, the corollary follows immediately from 
Theorem 4.33. 


Corollary 4.35. If || f’(0)|| < 1, then the zero solution of (4.6.5) is 
exponentially stable. 


PROOF. Since p(f’(0)) < || f’ (O)|, the proof follows from Corollary 
4.34. 


A Remark about Corollaries 4.34 and 4.35 


It is possible that || A|| > 1 but p(A) < 1. For example, 


3 3 
|Alloo = 5; Al = 5. 


However, p(A) = 3. With the above matrix A, the zero solution of the 
system a(n + 1) = Ax(n) + g(a(n)) is exponentially stable, provided that 
g(x) = o(x) as ||x|| + 0. Obviously, Corollary 4.35 fails to help us in deter- 
mining the stability of the system. However, even with all its shortcomings, 
Corollary 4.35 is surprisingly popular among scientists and engineers. 

It is also worthwhile to mention that if p(A) < 1, there exists a nonsin- 
gular matrix Q such that ||Q~'AQ]| < 1 [85]. One may define a new norm 
on A, ||Al| = ||Q7!AQ||, and then apply Corollary 4.35 in a more useful 
way. 

Let us return to our example where 


0.5 1 
A= ; 
( 0 a 
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Let 
Q= f s) 
Then 
e (0 se) 
and 


4 _ {05 a 
Q so=(" a) 


We have ||Q~1AQ||, = a+ 0.5. If we choose a < 0.5, then ||Q~1AQ||; < 1. 
The above procedure may be generalized to any Jordan block 


A Gt, Gate ay i 
À 
A — 
ae 1 
0 0 À 
In this case, we let Q = diag(1,a,a?,...,a*~!), where k is the order of A. 
Hence, 
a e | 
AÀ : 
|Q-*AQ|| = a , 
E: a 
0 0 À 


and |(Q~'AQ||1 = |A| + |a| (see Exercises 4.1, Problems 3 and 4). Con- 
sequently, if |A] < 1, one may choose an a such that |A| + |a| < 1, so 
that under the matrix norm || A|| = ||Q~1AQ||1, || A|| < 1. We now give two 
examples to illustrate the preceding conclusions. 


Example 4.36. Investigate the stability of the zero solution of the planar 
system 


y(n + 1) = ayo(n)/[1 + yi(n)], 
y(n +1) = byi (n)/[1 + y3 (n)]. 


(4.6.13) 
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Solution Let f = (fi, f2)”, where fı = ayo(n)/[1 + y?(n)] and fo = 
by: (n)/[1 + y3(n)]. Then the Jacobian matrix is given by 


afı(0,0) fı (0,0) 


of _ Oy, Oy2 _ 0 a 
Oy. Oy2 


Hence system (4.6.13) may be written as 


n(n+ 9 _ ( ) ee 7 Eo i n 
y(n +1)) \b OF \yo(n)} © \—bya(n)yn(n)/[ + y(n) J 


or as 


y(n + 1) = Ay(n) + g(y(n)). 


The eigenvalues of A are \; = Vab, åz = —Vab. Hence, if |ab| < 1, the zero 
solution of the linear part «(n+ 1) = Ax(n) is asymptotically sable: Since 
g(y) is continuously differentiable at (0,0), g(y) is o(y). Corollary 4.34 then 
implies that the zero solution of (4.6.13) is exponentially stable. 


Example 4.37. Pielou Logistic Delay Equation [119] 

In Example 2.39 we investigated the Pielou logistic equation 
ax(n) 

1+ Bax(n)° 


If we now assume that there is a delay of time period 1 in the response 
of the growth rate per individual to density change, then we obtain the 
difference delay equation 


a(n+1)= 


ay(n) 
1+ By(n—1)’ 


An example of a population that can be modeled by (4.6.14) is the blowfly 
(Lucilia cuprina) (see [107]). Find conditions on a, 8 for which the positive 


equilibrium point y* = cam is asymptotically stable. 


y(n+1)= a>l, 6>0. (4.6.14) 


Solution 


Method (1): Let y(n) = y(n) — (a — 1)/8. Then (4.6.14) becomes 


9(n +1) = Se ee =1) (4.6.15) 


The equilibrium point 7*(n) = 0 of (4.6.15) corresponds to y* = (a — 
1)/G. To change (4.6.15) to a planar system, we let 


x(n) =Y(n—1) and gz(n)= y(n). 
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Then 
x(n) 
xıln+ 1 
(i : 4 i = | azə(n) - (a - 1)zı(n) |- (4.6.16) 
2 a+ Bx1(n) 


By linearizing (4.6.16) around (0, 0) we give it the new form 
a(n +1) = Azr(n) + g(x(n)), 


where 
0 1 
A= |{1-a 1 
a 
and 
0 
g(t) = | b(a — 1)r? — apzız2 
a(a+ B21) 


The characteristic equation of A is A? — A + ant = 0. Thus by condition 
(4.3.3) the eigenvalues of A are inside the unit disk if and only if 1 < 
ant +1<2,0or0< s < 1, which is always valid, since a > 1. 

Therefore, p(A) < 1 for all a > 1. Since g(x) is continuously differen- 
tiable at (0,0), the zero solution of (4.6.16) is uniformly asymptotically 
stable. Consequently, the equilibrium point «* = (a — 1)/8 of (4.6.14) is 
asymptotically stable. 


Method (2): Letting y(n) = (a@—1)/Gexp(ax(n)) in (4.6.14), we obtain the 
new equation 
F exp((n)) 
{1 + (a — 1) exp(x(n—1))}/a° 
Taking the logarithm of both sides, we get 


exp(z(n + 1)) 


n(n +1) — e(n) + “= fef- 1] =0, 
or 
E ENE “= fle(n)] =0, (4.6.17) 
where 
fa) = on] SVE, 


The Taylor expansion of f around 0 is given by f(a) = 2+ g(a), where g(x) 

is a polynomial in x that contains terms of degree higher than or equal to 

2. Thus g(x) = o(a). The linearized equation of (4.6.17) is denoted by 
a-l 


x(n +2)—a(n+1)4 a x(n) =0. (4.6.18) 


226 4. Stability Theory 


Since the characteristic roots of (4.6.18) are the same as the eigenvalues of 
A, it follows that the zero solution (4.6.18) is asymptotically stable. Corol- 
lary 4.34 then implies that the zero solution of (4.6.17) is asymptotically 
stable. Since the equilibrium point y* = (a — 1)/8 corresponds to the zero 
solution of (4.6.17), it then follows that y* = (a—1)/( is an asymptotically 
stable equilibrium point of (4.6.15). 


Our final result deals with the cases p(A) = 1 and p(A) > 1. 
Theorem 4.38. The following statements hold: 
(i) If p(A) = 1, then the zero solution of (4.6.6) may be stable or unstable. 


(ii) If p(A) > 1 and g(x) is o(x) as ||x|| > 0, then the zero solution of 
(4.6.6) is unstable. 


(i) See Example 4.29. 


(ii) Assume that p(A) > 1. Then by Corollary 4.31, there exists a 
real symmetric matrix B that is not positive semidefinite for which 
BT AB — B = -C is negative definite. Thus the Liapunov function 
V(x) = a’ Bz is negative at points arbitrarily close to the origin. Fur- 
thermore, AV (x) = —x? Cx + 2a7 ATB g(x) + V(g(x)). Now, (4.5.6) 
allows us to pick y > 0 such that x?Cx > 44]||z||? for all z € R*. 
There exists ô > 0 such that if ||z|| < ô, then ||Bg(x)|| < y||a|| and 
V(g(x)) < yI|a||. Hence AV(x(n)) < —4||x(n)||?. Hence by Theorem 
4.27, the zero solution is unstable. 


Example 4.39. Let S(n) and I(n) denote the number of susceptibles and 
infectives, respectively, of a population at time n. Let d > 0 be the per 
capita natural death rate of the population and a > 0 be the disease 
related death rate. In the following model, suggested by Elaydi and Jang 
[47], a simple mass action 8ST is used to model disease transmission, where 
G3 > 0 and a fraction y > 0 of these infectives recover. Hence we have the 
following system 


S(n) + A+ yI(n) 


a ae 1+ BhI(n) + dh’ 
_ T(n) + BS(n)I(n) 
Ce acura 7 re ree (4.6.19) 


S(0), L(0) > 0. 
We make the assumption that 


w= PA-—d(d+y+a)>0 (4.6.20) 
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under assumption (4.6.20) equation (4.6.19) has two equilibria 
A d+y+a BA-—d(d+y+a) 
Xi =|- d X= : 
p= (G0) ama xg= (HA Se 


The linearization of (4.6.19) about X3 = (S*,J*) yields the Jacobian 
matrix 


1 y+ dy -— 5*8 — AB 
O 1+ 6I*+d (1+ BI* + d)? 
J= 
BI* 1 
l+d+y+a 
Notice that 
det J= 1 PI (y +dy- SB- AP) o 
1+8I*+d (l+d+y7+oa)+ 6I +d)? 
and 
trJ=1+ l >0 
Aia 1+8I*+d 4 


One may show that 
tr J <1+detJ <2. 


Hence by Theorem 4.33 and equation (4.3.9), the equilibrium point Xž is 
asymptotically stable. 

We now turn our attention to the equilibrium point Xf = (4, 0). The 
linearization of (4.6.19) about Xř yields the Jacobian matrix 


1 yt+dy-4@6-AB 


1l+d (1+ d)? 
J A 
0 aaa 
l+d+yta 
The eigenvalues of J are given by 
1+ 64 
M =— and = d 
L da OAS Tee 


By virtue of assumption (4.6.20), A2 > 1 and hence by Theorem 4.38(ii), 
the equilibrium point XŤ is unstable. 


Exercises 4.6 


1. Determine the stability of the zero solution of the equation 
x(n + 2) — a(n +1) +2z(n + 1)a(n) + a(n) =0. 
2. Judge the stability of the zero solution of the equation 
x(n +3) —2(n+1) +2x°(n) + 3z(n) = 0. 


228 


4. Stability Theory 


. Consider Example 4.25. Determine the stability and asymptotic 


1 1 1 1 
stability for the equilibrium points ; ; ; . 
: : (7 z) ( v2 z) 


(a) Hunt down the equilibrium points of the system: 
zı(n + 1) = x(n) — z2(n)(1 — z2(n)), 
gzə(n +1) = zı (n), 


za(n+1)= sra(n): 


(b) Determine the stability of all the equilibrium points in part (a). 


. Investigate the stability of the zero solution of the system: 


zi(n +1) = y21(n) = 23(n) + saln), 


x(n + 1) = zı (n) — z2(n) + z3(n), 


gza(n +1) = zı (n) — xo(n) + =23(n). 


. Linearize the equation 


xi(n +1) = sin(z2) — 0.521 (n), 
to(n + 1) = xz2/(0.6 + zı (n)), 


around the origin and then determine whether the zero solution is 
stable. 


(a) Find the equilibrium points of the system: 
xi(n +1) = cos xı (n) — x2(n), 
gza(n +1) = =x (n). 


(b) Is the point (7/2,—7/2) asymptotically stable? 


. Determine conditions for the asymptotic stability of the zero solution 


of the system 
zı(n + 1) = azı (n)/[1 + z2(n)], 
t2(n + 1) = [bz2(n) — zı (n)][1 + zı (n)]. 


. The following model of combat was proposed by Epstein [52], Sedaghat 


[133]. 
u(n +1) = u(n) + (a — u(n))la = ul) — vfr), 
ofn 1) = on) + E ulna — v(m) - d), 


where d < a, a > 0. 


Investigate the stability of the positive equilibrium point. 


10. 


11. 


12. 


13. 
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The following system represents a discrete epidemic model. The pop- 
ulation is divided into three groups: susceptibles S(n), infectives I(n), 
and immune or removed individuals R(n), n € Z*. If we assume the 
total population size equals N for all time, then S(n)+J(n)+R(n) = N 
and we then can eliminate one of the variables, say R(n). The model 
is given by 


S(n +1) = $(n) — FL(n)S(n) + BUN — $(n)), 
I(n+1) = I(n)(1— y- 8) + FA(n)S(n), 


with 0 < 6+~7 < 1 and 0 < a < 1. This model is called an SIR 
epidemic model. 


(a) Find all the equilibrium points. 
(b) Determine the stability of the equilibrium points. 
Consider system (4.6.19) under the assumption that 
o =BA-—d(dt+y+a) <0. 
(i) Show that there is only one equilibrium point Xf = (4,0). 
(ii) Show that Xř is asymptotically stable. 
(iii)*Show that XY is globally asymptotically stable. 


Show that if the zero solution of (4.6.2) is uniformly stable (uni- 
formly asymptotically stable), then the zero solution of (4.6.1) is also 
uniformly stable (uniformly asymptotically stable), provided that 
lg(n, y(n] < an|ly(m)||, where an > 0 and X- an < œ. 
n=0 

Suppose that the zero solution of x(n + 1) = Az(n) is asymptotically 
stable. Prove that the zero solution of y(n + 1) = [A+ B(n)]y(n) is 
asymptotically stable if 557o ||B(n)|| < cv. 


4.7 Applications 


4.7.1 One Species with Two Age Classes 


Consider a single-species, two-age-class system, with X(n) being the 
number of young and Y(n) that of adults, in the nth time interval: 


X(n+1) = bY(n), 
Y(n+1)=cX(n)+sY(n)-DY?(n). (4.7.1) 
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A proportion c of the young become adult, and the rest will die before 
reaching adulthood. The adults have a fecundity rate b and a density- 
dependent survival rate sY (n) — DY?(n). Equation (4.7.1) may be written 
in a more convenient form by letting X (n) = DX(n)/band Y(n) = DX(n). 
Hence we have 


X(n+1)=Y¥(n+1), 
Y(n+1) =aX(n) + s Y(n) — Y?(n), (4.7.2) 


with a = cb > 0. 

The nontrivial fixed point is (X*,Y*), with X* = Y* and Y* = a+s—1. 
Note that the equilibria X* and Y* must be positive in order for the model 
to make sense biologically. This implies that a+s—1 > 0. Since it is easier to 
do stability analysis on the zero equilibrium point, we let a(n) = X(n)—X* 
and y(n) = Y(n) — Y*. This yields the system 


a(n + 1) = y(n), 
y(n + 1) = aa(n) + ry(n) — y*(n),r = 2 — 2a — s. (4.7.3) 


The fixed point (0,0) corresponds to the fixed point (X yh) Local 
stability can now be obtained by examining the linearized system 
x(n + 1) = y(n), 
y(n + 1) = aa(n) + ry(n), 
whose eigenvalues are the roots of the characteristic equation 


X? —rrA—-a=0. 


By criteria (4.3.9), the trivial solution is asymptotically stable if and only 
if: 


(i) l-r-a>0 or a+s>1, and 
(ii) 1+r—-a>0 or 3a+s<3. 


Hence the range of values of a and s for which the trivial solution is asymp- 
totically stable is bounded by the region a = 1, s = 1, a+ s = 1, and 
3a + s = 3, as shown in Figure 4.27. 

The shaded region represents the range of parameters a, s for which the 
trivial solution is asymptotically stable. 

To find the region of stability (or the basin of attraction) of the trivial 
solution we resort to the methods of Liapunov functions. Let 


2arxy 
l-a 

Recall from calculus that Axz?+2Bry+Cy? = D is an ellipse if AC— B? > 
0, or a? — (cay > 0, ora—1<r<1-a. This reduces to s+a > 1 
and s < 3 — 3a, which is the shaded region in Figure 4.27. By rotating the 


V(a,y) = a?a? + +y. 
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1 


FIGURE 4.27. 


axes, one may eliminate the mixed term xy to obtain A’x? + O'y? = D, 
with A’ + C’ = a? +1 > 0. Moreover, A’C’ > 0. Hence both a and c 
are positive and, consequently, D is positive. Thus in the shaded region in 
Figure 4.27, V (x,y) is positive definite. 

After some computation we obtain 


AV (x,y) = YW (x,y), 


where 
2 2ar(r — y) 5 
W(x, y) = (y = r)* — 2ax a el 
Hence AV (x,y) < 0 if W (x,y) < 0, that is, if (x,y) is in the region 
2 = 
G= f(y) yar)? = 2a ED 5 92-1 oh. 
—a 


The region G is bounded by the parabola W (z, y) = 0. Now, in the region 
G, AV (x,y) = 0 on the z-axis y = 0. Hence F is the x-axis. But since (c, 0) 
is mapped to (0,ac), the largest invariant set M in E is the origin. Hence 
by Theorem 4.24 every bounded solution that remains in G will converge 
to the origin. 

We now give a crude estimate of the basin of attraction, that is, the set 
of all points in G that converges to the origin. Define 


Vmin = min{V (29, yo) : (£0, yo) € OG}, 
Jm = {X,Y} : X = r0 + X*, Ý =y+Ýľ*, 
V(z(m) y(m)) < Vmin, m= 0,1,2,.... 


Now, if (£0, Yo) € Jo, then V(x(1), y(1)) < V (£0, Yo) < Vmin, and hence 
(x(1),y(1)) € Jo. Similarly, one may show that (x(n), y(n)) € Jo for 
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n = 1,2,3,... and, consequently, as n + œ, (a(n), y(n)) > (0,0). Now, if 
(Xo, Yo) € Jm, then 


V(a(m + 1), y(m + 1)) < V(z(m), y(m)) < Vmin, 


and the argument proceeds as before to show that (z(n),y(n)) > 
(0,0) as n — oo. Hence the sets Jm are estimates of the basin of attraction 
of (X,Y). 


4.1.2 Host-Parasitoid Systems 


Consider a two-species model in which both species have a number of life- 
cycle stages that include eggs, larvae, pupae, and adults. Let 

H (n) = the density of host species in generation n, 

P(n) = the density of parasitoid in generation n, 

f(H(n), P(n)) = fraction of hosts not parasitized, 

A = host reproductive rate, 

c = average number of viable eggs laid by a parasitoid on a single host. 
An adult female parasitoid finds a host on which to deposit its eggs. The 
larval parasitoids consume and eventually kill their host. The life-cycle of 
both species is depicted in Figure 4.28. Then 

H(n + 1) = number of hosts in generation n x fraction not parasitized 
x reproductive rate A, 


P(n + 1) = number of hosts parasitized in generation n x fecundity 


of parasitoids c. 


ÍN 
ANS Oe 


aw 
~~ 
Adult Infected Larvae 
female host 
Parasitoid 


FIGURE 4.28. Host—Parasitoid. Schematic representation of host—parasite sys- 
tem. 
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Thus we have 


P(n +1) =cH(n)[1 — f(H(n), P(n))). (4.7.5) 


4.7.8 A Business Cycle Model 


One of the first formal mathematical models for business cycles was due to 
Paul Samuelson (1939). The model was later modified by Sir John Hicks 
(1950). Let I(n) denote the investment at time period n and Y (n) is the 
income at time period n. In the Samuelson—Hicks model, it is assumed that 
investment is proportional to income change, i.e., 


I(n) = o(Y(n—- 1) — Y(n- 2)). (4.7.6) 


Likewise, consumption C(n) is proportional to income Y(n — 1) in the 
previous period, i.e., 


C(n) = (1 — s)Y (n) (4.7.7) 


where 0 < s < 1 is the “complementary” proportion used. Introducing the 
accounting identity for a closed economy: 


Y(n) = C(n) + I(n) (4.7.8) 
we derive a simple second-order difference equation 


Y(n) = (14+vu—s)Y(n—-1)-—vY(n—-2). (4.7.9) 


The linear model (4.7.9) does not adequately represent a business since it 
does not produce oscillatory solutions (or periodic cycles) except for special 
cases (such as v = 1). 

A nonlinear cubic model 


I(n) = of ¥(n — 1) — Y (n — 2)) — v(¥(n — 1) — Y (n — 2))3, (4.7.10) 
C(n) = (1 — s)Y (n — 1) + esY (n — 2), (4.7.11) 


was proposed in Puu [124] and [125]. A fraction 0 < £ < 1 of savings was 
assumed to be spent after being saved for one period. So for e = 0, the 
original Hicks model (4.7.7) is recovered. 

Let us introduce a new variable 


=Y(n-1)-Y(n-2). (4.7.12) 
Adding (4.7.10) and (4.7.11) and using (4.7.8) yields 


Y(n+1)=I(n+1)+C(n+1) 
= 0(Y(n) —Y(n—1))+ (1 -— s)Y (n) 
+ esY(n—1) —v(¥(n) —Y(n—-1))?. 
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Subtracting Y (n) from both sides yields 
Z(n) = (v — es)Ž(n — 1) — v’ (n) + (e — 1)sY (n — 1). 


oE === zn). 
Then 


Z(n) = (v = es)Z(n — 1) — (1 +v — es) Z? (n — 1) + (e — 1)sY (n — 1). 
Let a = (v — £s), (e — 1)s = b. We get 
Z(n +1) =aZ(n) — (1 +a)Z?(n) + bY (n) (4.7.13) 


Let 


where b = (1 — €)s represents a sort of eternal rate of saving. Using (4.7.12) 
and (4.7.13) we now have the two-dimensional system 


Y(n+1)=Y(n)+ Z(n), 
Z(n +1) = aZ(n) — (a + 1)Z7(n) — bY (n). (4.7.14) 


System (4.7.14) has a single equilibrium point X* = (Y*,Z*) = (0,0). 
Local stability can now be obtained by examining the linearized system 


Y(n+1) 1 1)\ [Y(n) 
a + 4 z L, ‘ ee ee) 


The eigenvalues are given by 


a+1 (a — 1)? — 4b 


M2 = s (4.7.16) 
By criteria (4.3.9), the trivial solution is asymptotically stable if and only 
if: 
(i) 2+2a+b>0, 
(ii) b >0, 


Gii) 1-a- b> 0. 


Taking into account that a > 0 and 0 < b < 1, the region of stability S is 
given by 


S= {(b,a)|0<b<1,0<a<1-b}. 


We conclude that if (b,a) € S, then equilibrium X* = (0,0) is 
asymptotically stable (Figure 4.29). 

Notice that the eigenvalues 1, A2 are complex numbers if 1—2V/b < a < 
1+2V. But this is fulfilled if (b,a) € S. Thus if (b,a) € S, the equilibrium 
point X* = (0,0) is a stable focus. 

At a = 1 — b, the equilibrium point X* = (0,0) loses it stability and 
possible appearance of cycles. For example, for a = 0, b= 1, an attracting 
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FIGURE 4.29. The region of stability S is the shaded area. 


cycle of period 6 and a saddle cycle of period 7 appear. At a = v2 — 1, 
b = 2 — V2 and attracting and saddle cycles of period 8 appear and so on 
[126]. 


4.1.4 The Nicholson-Bailey Model 
In [107] the function f was specified under two assumptions: 


1. The number of encounters He of hosts by parasitoids is proportional 
to the product of their densities, that is, 


H. = aH(n)P(n). (4.7.17) 


2. The first encounter between a host and a parasitoid is the only signif- 
icant encounter. Since the encounters are assumed to be random, it is 
appropriate to use a Poisson probability distribution to describe these 
encounters. 


If u is the average number of events in a given time interval, then the 
probability of r events (such as encounters between host and its parasitoid) 
is 
et u” 


3 


P(r) = I 
Ae 


with u = yr. It follows from equation (4.7.17) that 


pp = aP(n). (4.7.18) 


Since the likelihood of escaping parasitism is the same as the probability of 
no encounters during the host lifetime, f(H (n), P(n)) = é¢?™. Equations 
(4.7.4) and (4.7.5) now become 


H(n+1) = AH (n), (4.7.19) 
P(n +1) = cH(n)(1 — et? ™), (4.7.20) 


236 4. Stability Theory 


r(1—N*/K)/acN* 
a 


1—exp(—r(1—H’/K)) 
è” 


FIGURE 4.30. 


The nontrivial equilibrium points are given by 
d\n AÀ 1 
H* = ——, P*==—ln\. 
(A—1) ac’ a 
It can be shown by linearization that (H*, P*) is unstable. Thus this model 
is too simple for any practical applications except possibly under contrived 
laboratory conditions. 
It is reasonable to modify the H(n) equation (4.7.4) to incorporate some 
saturation of the prey population, or, in terms of predator encounters, a 
prey-limiting model. Hence a more realistic model is given by 


H(n+1) = H(n) exp i (1-2) = aP(n)], r>0, 
P(n +1) =cH(n)(1 — exp(—aP(n))). (4.7.21) 


The equilibrium points are solutions of 


HY* 
1 = exp b (1- ) -aP , P* = cH* (1 — exp(—a P*)). 


K 
Hence 
r H* r P* 

P* = 1 =-(1 H" =e; 4.7.22 
| Z| z070) Oer) ( ) 

Thus 

r(1— Æ) H* 

cai 1 — exp | r (: K )| ; (4.7.23) 


Clearly, Hf = K, Př = 0 is an equilibrium state. The other equilibrium 
point may be obtained by plotting the left- and right-hand sides of (4.7.19) 
against H*. From Figure 4.30 we see that there is another equilibrium point 
with 0 < H3 < K. Then we may find P} from (4.7.18). 
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To perform the stability analysis of the equilibrium point (H3, P3), we 
put H(n) = x(n) + HZ, P(n) = y(n) + Py. Hence we obtain 


a(n +1) = -H3 + (a(n) + H3)exp [e (1- SEE) — atu) + Po), 
y(n + 1) = -P3 + c(a(n) + H3)[1 — exp(—a(y(n) + P3))]. (4.7.24) 
By linearizing around (0,0) we obtain the linear system 
x(n + 1) x(n) 
(00) 4 (8) ana 
with 
A= aad: Pi (4.7.26) 
e(l—exp(—r(1—9@)) p=r(1-4)) 


H* 
where q = x and 


r(l—4) 
1—exp(—r(1—q)) 
The details of obtaining the matrix A will be left to the reader. Observe 


that the value of q = H2 is a measure of the extent to which the predator 
can depress the prey below the carrying capacity. 


The characteristic equation of A is given by 
X —A1l—-r+y)+(1—rayetr’q(1 -g =0. (4.7.27) 


By criterion (4.3.9), the eigenvalues of A lie inside the unit disk if and only 
if 


BNUBWRUDAIBHDO 


FIGURE 4.31. The origin is asymptotically stable within the shaded area. 
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Hence 


(L—ra)p+r7q(l—4q) <1, (4.7.28) 
1+(1—rge+r7q(1 -q > ll—r+g¢l. (4.7.29) 


Plotting (4.7.24) and (4.7.25) gives the region of asymptotic stability 
indicated by the shaded area in Figure 4.31. 

The origin is asymptotically stable within the shaded area. Note that the 
area of stability narrows as r increases. 

Beddington et al. [7] conducted a numerical simulation for the specific 
value q = 0.4. As r grows past a certain value, the equilibrium point 
becomes unstable and a hierarchy of stable limit cycles of increasing, non- 
integral period, ultimately breaking down to cycles of period 5, appears. 
These are followed by cycles of period 2 x 5, 22 x 5,...,2" x 5,.... 


4.7.5 The Flour Beetle Case Study 


The team of R.F. Costantino, J.M. Cushing, B. Dennis, R.A. Deshar- 
nais, and S.M. Henson [27] have studied the flour beetles extensively. They 
conducted both theoretical studies as well as experimental studies in the 
laboratory. To describe their model, we will give a brief background of the 
life-cycle of the flour beetles. The life-cycle consists of larval and pupal 
stages each lasting approximately two weeks, followed by an adult stage 
(see Figure 4.32). 

As is shown in Figure 4.32, cannibalism occurs among the various groups. 
Adults eat pupae and eggs, larvae eat eggs. Neither larvae nor adults eat 
mature adults. Moreover, larvae do not feed on larvae. The cannibalism 
of larvae by adults and of pupae by larvae is assumed negligible since it 
typically occurs at much reduced rates. 

Let L(n) be the larvae population at time period n, let P(n) be the pupal 
population at time period n, and let A(n) be the adult population at time 


AS 


i Eggs Pupae į 7 


FIGURE 4.32. The arrows show the cannibalistic interaction between difference 
life-cycle stages. 
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period n. Then the larval—pupal—adult (LPA) model is given by 
L(n + 1) = bA(n) exp(—cge,A(n) — cgr L(n)), 
P(n +1) = (1 — wr) L(n), (4.7.30) 
A(n +1) = P(n)exp(—epaA(n)) + (1 — pa) A(n), 


where L(0) > 0, P(0) > 0, A(0) > 0. 

The constants uz, wa are the larval and adult probability of dying from 
causes other than cannibalism, respectively. Thus 0 < pr < 1 and 0 < 
La <1. The term exp(—cg,4A(n)) represents the probability that an egg 
is not eaten in the presence of A(n) adults, exp(—cer,L(n)) represents 
the probability that an egg is not eaten in the presence of L(n) larvae, 
and exp(—cp4A(n)) is the survival probability of a pupa in the presence 
of A(n) adults. The constants cga > 0, cer, > 0, cpa > 0 are called 
the cannibalism coefficients. We assume that adult cannibalism is the only 
significant cause of pupal mortality. 

There are two equilibrium points (0,0,0)7 and (L*, P*, A*) € RÌ, L* > 
0, P* > 0, A* > 0. The positive equilibrium point may be obtained by 
solving the three equations 


Lexp(ceLL) = bAexp(—cgaA), 
P=(1-pr)L, (4.7.31) 
La exp(cpyA) = P. 


Eliminating P yields 


(1 — pr )L = paAexp(cpaA), 
Lexp(ceLL) = bAexp(—craA). 


Dividing the second equation by the first yields 


b(1 — 
exp(ceLL) = ( ae exp|(—cza — cpa)Al. (4.7.32) 
The number 
y= Oh = He) 
HA 


is called the inherent net reproductive number. This number will play a 
significant role in our stability analysis. Observe that if N < 1, equa- 
tion (4.7.32) has no solution and we have no positive equilibrium point. 
However, if N > 1, then equation (4.7.32) has a solution which is the inter- 
section of the curve (1 — uz)L = wa exp(cpĘ A) and the straight line from 
(0, ln N/cgL) to (ln N/(cea + cpa), 0) in the (A, L)-plane represented by 
equation (4.7.32). To investigate the local stability of the equilibrium point 
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(L, P, A) of equation (4.7.30), we compute the Jacobian J, 


—eppbAe’#44-cart) 0 be(-cenl—ceaA)(1—ceaA) 
J= i=j 0 0 
0 eeraa) j HA — cpaPe\°P44) 
(4.7.33) 


At the equilibrium point (0,0,0)7 we have 


0 0 b 
Ji = Jior = |1- ur 0 0 
0 1 1—ua 


The characteristic polynomial of J; is given by 


P(A) = à — (1 — pa)d? — b(1 — wp) = 0 (4.7.34) 


which is of the form 
P(A) = X? + pid? + pod + ps = 0, 


with pı = —(1— a), p2 = 0, ps = —b(1 — pz). 
According to (5.1.17), the eigenvalues of J; are inside the unit circle if 
and only if 


lp3 +pı| < 1+p2 and |ps—p3pi| <1 — ps. 
Applying the first condition yields 


[Sel = fin) (Gia) < 1, 
b(1 — wr) + (1 — wa) <1, 


i= 
nya See) 23. (4.7.35) 
HA 


The second condition gives 
|—(1 — ua)(1 — ur)b| < 1- b? (1 — ur)’, 
b°(1 — wr)? + (1—pa)(1 — ur)b <1. 


But this inequality is satisfied if we assume (4.7.35). For if N < 1 we have 


b°(1 — wr)? + (1 — a)(1— ur)b < ph + uall- wa) = pa S11. 


We conclude that the trivial equilibrium is asymptotically stable if and 
only if N < 1, and thus attracts all orbits in the nonnegative cone. As N 
increases past 1, a “bifurcation” occurs which results in the instability of 
the trivial equilibrium and the creation of the positive equilibrium. In fact, 
for N > 1 there exists one and only one positive equilibrium. The Jacobian 
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at the positive equilibrium (L*, P*, A*) satisfying (4.7.31) is given by 


* 


—cryL* 0 Ae = cga L* 
J = Jhesa = | 1— pp 0 0 
0 A* exp(cpa) 1—pa—A*pacpa 


The characteristic equation is given by 
d+ (cei L* + wacpaA™ — (1 —a))A? — ceLL* (1 — pa)A— 


(= — oxar”) (1 — uL)exp(—cpaA*) = 0. 
As of writing this edition of the book, a condition for the stability of the 
positive equilibrium is known only in special cases. 
Case (i) If cer, = 0, the positive equilibrium is globally attracting if 
1 < N <emin{(1, (cwa/cpa)((1— a)/Ha)} [83]. 


Case (ii) In several long term experiments reported in [27], the adult death 
rate was manipulated to equal 96% and hence ua = 0.96. Motivated by this 
data, Cushing [25] assumed that p4 = 1. In this case we have N = b(1— uz) 
and equation (4.7.30) becomes 


L(in+1)= ~— A(n) exp(—cerL(n) — cea A(n)), 


= 
P(n+1) = (1 — wr) L(n), (4.7.36) 
A(n + 1) = P(n) exp(—cpaA(n)). 

Theorem 4.40 [25]. For N > 1, the trivial equilibrium of equation 

(4.7.36) is unstable and there exists a unique positive equilibrium. This 


positive equilibrium, which bifurcates from the trivial equilibrium at N = 1, 
is unstable for N = 1 + ô, where ô is sufficiently small. 


A subcase of Case (ii) is the case of synchronous orbits. A triple 
(L(n), P(n), A(n)) is said to be synchronous at time n if one com- 
ponent equals zero and at least one component is nonzero. One can 
see immediately from equation (4.7.36), that an orbit that is syn- 
chronous at time no is synchronous for all n > no. Notice that a 
point (Lo, Po,0)" in the L,P-plane is mapped to the point (0,(1 — 
uL)Lo, Po)’ in the P, A-plane, which in turn is mapped to the point 


Po exp(—cga Po), 0, (1 — wr) Lo exp(—cpaPo)") in the L, A-plane. 
Hence points are mapped from one nonnegative quadrant of the co- 
ordinate planes to the next in sequential order. A synchronous triplet 
(L(n), P(n), A(n))” is said to be fully synchronous at time n if it has two 
zero components. This is the case for points on the positive coordinate 
axes. An orbit is fully synchronous if and only if its initial point is fully 


242 4. Stability Theory 


0,- u ,) L, P) 


((N/(1-u ) P, exp(-c_, P), 0,(1-u,) L exp(-c „P,)) 


EA 0 


(L,,P,,0)" 
FIGURE 4.33. 


synchronous. This notion is derived from the fact that the three life-cycle 
stages are synchronized temporarily in such a way that they never overlap. 
Denote the map (4.7.36) by F, 


L(n+1) L(n) 
P(n+1)| =F | P(n)]. (4.7.37) 
A(n + 1) A(n) 


Then F? maps the nonnegative quadrant of a coordinate plane to itself. 
A fixed point of F? corresponds to a 3-cycle of F and so on. The map F°’ 
is defined by the equations 


x(n +1) = Na(n) exp |- cpay(n)exp(—cpaz(n)) 
— crA(1 — pr)e(n) exp(—cpay(n) exp(—cpaz(n))) 


y(n) exp(—cpay(n) — cray(n) exp(—cpaz(n))) 


N 
~C T 
1— py 


— CEL R z(n) exp ( — CEA z(n)exp(—cgaz(n) 


1— 1— pr 
= ceix(n)))| l (4.7.38) 
y(n + 1) = Ny(n)exp | — cpaz(n) — cray(n) exp(—cp.az(n)) 


z(n) exp(—cgaz(n) — cerg(n))], (4.7.39) 


N 
aes HL 
z(n + 1) = Nz(n) exp | — ceaz(n) — crre(n) 
— cpa(1 — ur)æ(n) exp(—cpay(n) exp(—cpaz(n)))]- 

If (9,0, 29)” is a point in the z, z-plane, then its orbit is described by the 
two-dimensional system 

x(n + 1) = Na(n) exp(—cx(n)), (4.7.40) 

z(n + 1) = [Nexp(—az(n))]z(n) exp(—Gz(n)), (4.7.41) 
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where c = cea(1— uL), a = cer t+cpa(l— uL), b= CEA. 

The first equation (4.7.40) is the well-known Ricker’s map, where 
limno s(n) = 0 and the convergence is exponential. Hence equation 
(4.7.41) may be looked at as a perturbation of (4.7.40). Hence by Corollary 
8.27, limno 2(n) = 0 which is consistent with what we had earlier. For 
N > 1, Ricker’s map has a unique positive equilibrium «* = In N/c. Con- 
sequently, there exists a fully synchronous 3-cycle of equation (4.7.36). As 
N increases, Ricker’s map undergoes a period-doubling bifurcation route 
to chaos. If 1 < N < e, then (a*, z*)? = (4 In N,0)” is an asymptotically 
stable equilibrium point of equations (4.7.40) and (4.7.41) and globally at- 
tracts all positive initial conditions in the x, z-plane. This fixed point of F’ 
corresponds to the fully synchronous 3-cycle of the LPA model (4.7.36) 


In N 0 0 
cra(l — pr) 1 0 
> | — hN | > (4.7.42) 
0 CEA 1 nN 
—— Nh 
0 0 bea 


Thus we have the following result. Theorem 4.40 [25] for 1 < N < e?, the 
LPA model (4.7.36) has a unique, nontrivial fully synchronous 3-cycle given 
by (4.7.42). This 3-cycle attracts all fully synchronous orbits or equation 
(4.7.36). For N > e?, the system has a period-doubling cascade of fully 
synchronous (3 x 2”)-cycle attractors and, for sufficiently large N, has “fully 
synchronous chaotic” attractors (with respect only to fully synchronous 
orbits). 

This is the first proof of the presence of chaos in a population model. 

Details about synchronous but not fully synchronous orbits may be found 
in Cushing [25]. There are still many open problems that need to be tackled. 
We invite the reader to solve them. 


Open Problem 1. Investigate the LPA model for the general case ua # 1. 
For a starting point, try the case with ua = 0.96. 


Open Problem 2. Investigate the behavior of orbits that are not syn- 
chronous provided that ua = 1. 


5 


Higher-Order Scalar Difference 
Equations 


In Chapter 4 we investigated the qualitative behavior of systems of dif- 
ference equations, both linear and nonlinear. In this chapter we turn our 
attention to linear and nonlinear higher-order scalar difference equations. 
Although one may be able to convert a scalar difference equation to a 
system, it is often advantageous to tackle the scalar difference equation 
directly. Moreover, since a system of difference equations may not be con- 
vertible to a scalar difference equation, results on the latter may not extend 
to the former. Every section in this chapter was written with this statement 
in mind. Section 5.1 gives explicit necessary and sufficient conditions for the 
stability of the zero solution of a kth-order scalar difference equation. This 
task is accomplished either via the Schur-Cohn criterion or by using spe- 
cial techniques that were developed by Levin and May [90], Kuruklis [86], 
Dannan [28], and Dannan and Elaydi [29]. Section 5.2 provides easy com- 
putable sufficient conditions for asymptotic stability using Gerschgorin’s 
Theorem which provides a rough estimate of the location of eigenvalues of 
matrices. 

In the first and second editions of this book I have used Rouché’s The- 
orem from complex analysis to obtain the results in Section 5.2. However, 
the new approach is not only more accessible to readers with no background 
in complex analysis but, more importantly, it is much more intuitive. Sec- 
tion 5.3 treats nonlinear equations via linearization and follows closely the 
exposition in Section 4.4 for systems. Section 5.4 collects the main results 
in global stability of nonlinear scalar difference equations. It remains an 
open question of whether or not these results extend to nonlinear systems 
of difference equations. Finally, Section 5.5 presents the larval-pupal-adult 
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(LPA) model of flour beetles with no larval cannibalism on eggs, and a 
mosquito model. 


5.1 Linear Scalar Equations 


Consider the kth-order difference equation 


a(n+k)+pie(nt+k—1)+ pot(n+k—2)+---+ppu(n) =0 (5.1.1) 


where the p;’s are real numbers. 

It follows from Corollary 2.24 that the zero solution of (5.1.1) is asymp- 
totically stable if and only if |A| < 1 for all characteristic roots A of (5.1.1), 
that is, for every zero A of the characteristic polynomial 


P(A) = A¥ + pve t +--+ + pe. (5.1.2) 


Furthermore, the zero solution of (5.1.1) is stable if and only if |A| < 1 
for all characteristic roots of (5.1.1) and those characteristic roots A with 
|\| = 1 are simple (not repeated). On the other hand, if there is a repeated 
characteristic root A with |A| = 1, then according to Corollary 2.24 the zero 
solution of (5.1.1) is unstable. 

One of the main tools that provides necessary and sufficient conditions for 
the zeros of a kth-degree polynomial, such as (5.1.2), to lie inside the unit 
disk is the Schur—Cohn criterion. This is useful for studying the stability 
of the zero solution of (5.1.1). Moreover, one may utilize the Schur-Cohn 
criterion to investigate the stability of a k-dimensional system of the form 


x(n+1) = Aaz(n) (5.1.3) 


where p(A) in (5.1.2) is the characteristic polynomial of the matrix A. 

But before presenting the Schur—Cohn criterion we introduce a few 
preliminaries. 

First let us define the inners of a matrix B = (b;;). The inners of a matrix 
are the matrix itself and all the matrices obtained by omitting successively 
the first and last rows and the first and last columns. For example, the 
inners for the following matrices are highlighted: 


A 5 x 5 matrix 

A 4 x 4 matrix 
A 3 x 3 matrix bit by2 big bia bis 
bii bi2 big bia 


bii bi2 big 
b21 | b22 b23 | b24 
b21 | b22 | b23 |, i 
b31 | b32 b33 | b34 
b31 b32 b33 


bat b42 b43 baa 
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A matrix B is said to be positive innerwise if the determinants of all of 
its inners are positive. 


Theorem 5.1 (Schur—Cohn Criterion) [74]. The zeros of the charac- 
teristic polynomial (5.1.2) lie inside the unit disk if and only if the following 
hold: 


(i) p01) > 0, 
(ii) (—1)*p(-1) > 0, 
(iii) the (k — 1) x (k — 1) matrices 


1 0 0 0 0 0 Dp 
pı 0 0 0 Pk Pk-1 
Bry = m : 
Pk-3 0 Pk P3 
Pk-2 Pk-3 ++» Pr 1 Pk Pk-i ++» P3 P2 


are positive innerwise. 


Using the Schur-Cohn criterion (Theorem 5.1), one may obtain necessary 
and sufficient conditions on the coefficients p,;’s such that the zero solution 
of (5.1.1) is asymptotically stable. Neat and compact, necessary and suffi- 
cient conditions for the zero solution of (5.1.1) to be asymptotically stable 
are available for lower-order difference equations. We will present these 
conditions for second- and third-order difference equations. 

For the second-order difference equation 


x(n +2) + pix(n +1) + pox(n) = 0 (5.1.4) 
the characteristic polynomial is 
p(A) =? + pir + pr. (5.1.5) 
The characteristic roots are inside the unit disk if and only if 
pl) =1+p1+p2 >0, (5.1.6) 
p(—1) = 1 — pı + p2 > 0, (5.1.7) 
BF =1+p >00. (5.1.8) 


It follows from (5.1.6) and (5.1.7) that 1+ po > |pı| and 1 + p2 > 0. Now 
(5.1.8) reduces to 1 — po > 0 or po < 1. Hence the zero solution of (5.1.4) 
is asymptotically stable if and only if 


[pi] < 14+ po < 2. (5.1.9) 


For the third-order difference equation 


x(n +3) + piz(n + 2) + poz(n + 1) + p32(n) = (5.1.10) 
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the characteristic polynomial is 


A? + pid” + por + ps = 0. (5.1.11) 
The Schur—Cohn criterion are 
1+pi+p2+p3 > 0, (5.1.12) 
(—1)?[-1+ pı — p2 + ps] = 1 — pı + p2 — ps > 0 (5.1.13) 
1 0 0 1 
|BF| = + Ke Es l 
pı 1 p3 p2 pı +ps 1+p2 
Thus 
1 + p2 — pips — p3 > 0 (5.1.14) 
and 
1 0 0 1 — 
|B; |= - Psj | PRS (5.1.15) 
pı 1 p3 p2 pı -ps 1l—pe 
Hence 


1 — po + p3pı — p3 > 0. (5.1.16) 


Using (5.1.12), (5.1.13), (5.1.14), and (5.1.16), we conclude that a nec- 
essary and sufficient condition for the zero solution of (5.1.10) to be 
asymptotically stable is 


|pı +ps| < 1+p2 and |p2-— pıps| < 1 — på. (5.1.17) 


It is now abundantly clear that the higher the order of the equation, 
the more difficult the computation involved in applying the Schur-Cohn 
criterion becomes. However, Levin and May [90], using a very different 
technique, were able to obtain a simple criterion for the asymptotic stability 
of the following special equation 


z(n+1)-— z(n)+qz(n — k) =0, (5.1.18) 


or, equivalently, 


s(n +k +1)-— z(n + k) + qz(n) = 0. (5.1.19) 


Theorem 5.2. The zero solution of (5.1.18) is asymptotically stable if 
and only if 


0 <4 < 2e0s ( (5.1.20) 


kr 
2k+1/` 

The proof of this theorem is given in Appendix E. The theorem may 
also be obtained as a corollary of a more general theorem by Kuruklis [86] 
which we now state. 
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o5 | 


(i) k odd (ii) k even 


FIGURE 5.1. The graphs of the domains of (a,b), for which the roots of \*t! — 
aà! +b = 0, with a £ 0 and k > 1, are inside the unit disk. The curved sides 
are parts of |b| = |a? + 1 — 2|a| cos ol?, where ¢ is the solution in (0,7(k + 1)) of 
sin(k@) /sin(k + 1)0 = 1/|al. 


Contemplate the equation 
a(n+1)—aa(n)+ba(n—k)=0, neZt. (5.1.21) 


Theorem 5.3. Let a be a nonnegative real number, b an arbitrary 
real number, and k a positive integer. The zero solution of (5.1.21) is 
asymptotically stable if and only if |a| < (k + 1)/k, and: 


(i) jal —1 <b < (a? +1 —2lalcos$)? fork odd, or 
(ii) |b— a| <1 and |b| < (a? +1 —2|a|cos¢)? for k even, 
where ġ is the solution in (0,7/(K+1)) of sin(k0)/sin(k +1)6 = 1/ļa|. (See 
Figure 5.1.) 
Using the above theorem we present a simple proof of Theorem 5.2. 


PROOF OF THEOREM 5.2. 
From Theorem 5.3 we have that the zero solution of the difference 
equation (5.1.19) is asymptotically stable if and only if 


0<b<(2—2cos$)? for k odd (5.1.22) 
or 
|b — 1| <1 and |b| < (2—2cos¢)? for k even, (5.1.23) 
where ¢ is the solution in (0,7/(& + 1)) of 
sin(k6) /sin(k + 1)0 = 1. (5.1.24) 


Note that |b — 1| < 1 implies b > 0. Therefore conditions (5.1.22) and 
(5.1.23) are reduced to 


0<b<(2—2cos¢$)?. (5.1.25) 
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Also note that 


(2 —2cos¢)? = [2(1 — cos ¢)]? = [4sin?(6/2)]? = 2sin($/2) 
and thus (5.1.25) can be written as 


0 <b < 2sin(¢/2). (5.1.26) 
Furthermore, (5.1.24) yields sin(k@) = sin|(k + 1)¢] and so either 
kot (k+1)6 = (2n +1)r (5.1.27) 
or 
ko = (k + 1)¢+ 2nz, (5.1.28) 


where n is an integer. Since (5.1.28) cannot be valid for 0 < ¢ < m/(k+1) 
we have that (5.1.27) holds. In fact, 0 < ¢ < m/(k +1) forces n = 0 
and so ¢ = 7/2 and thus condition (5.1.25) may be written as 0 < b < 
2cos[km/(2k + 1)], which is the condition of Theorem 5.3. 


Dannan [28] considered the following more general equation 


a(n +k) +ax(n)+ba(n—-1)=0, neZt, (5.1.29) 


where k > 1 and l > 1 are integers. 


Theorem 5.4 [28]. ZLetl> 1 and k > 1 be relatively prime odd integers. 
Then the zero solution of (5.1.29) is asymptotically stable if and only if 
ja| <1 and 


jaJ—1 < bmin(1 + a? — 2ļa] cos kô)? (5.1.30) 
where S is the solution set of 


1 —— sin 16 
ja} sin(l + k)@ 


(5.1.31) 


on the interval (0,7). 


Theorem 5.5 [28]. Let 1 > 1 be an odd integer, k an even integer, with l 
and k relatively prime. Then the zero solution of (5.1.29) is asymptotically 
stable if and only if 


|b] <1-—Ja| for -—1l<a<0 (5.1.32) 
and 
lel < min (1 + a? + 2a cos k0)? for0<a<1, (5.1.33) 
where S* is the solution set of 
1 sin 10 
a sin(l+k)0 


(5.1.34) 


on the interval (0,7). 
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Theorem 5.6 [28]. Let | be an even integer and k > 1 an odd integer, 
where l and k are relatively prime. Then the zero solution of (5.1.29) is 
asymptotically stable if and only if 


la — 1 < bmin(1 + a? — 2la| cos k0)? for -1<a<0 (5.1.35) 
= 


and 
a— 1< —b < min(1 + a? — 2a cos k0)? for 0<a<l. (5.1.36) 
€ 


where S is as in Theorem 5.4. 


Remark: If l and k in Theorems 5.4, 5.5, and 5.6 are not relatively prime, 
then 1 = sl and k = sk for some positive integers s, i, and k, where l and 
k are relatively prime. The asymptotic stability of (5.1.29) is equivalent to 
the asymptotic stability of 


a(n +k) + ax(n) + ba(n— 1) = 0. (5.1.37) 
(Why?) The reader is asked to prove this in Exercises 5.1, 5.2, Problem 5. 


Example 5.7. Consider the difference equation 


x(n + 25) + ax(n) + ba(n-—15)=0, n=0,1,2,.... 


The corresponding characteristic equation is 
A + ad? +b =0, 


and in the reduced form is 


+ ad°+b=0. 


Here we have | = 5 and k = 3. T herefore, Theorem 5.5 is applicable and 
the given equation is asymptotically stable if and only if |a| < 1 and 


la| — 1 < bmin(1 + a? — 2|a| cos 30)?, 
OES 


where S is the solution set of l = 5 56 on the interval (0,7). If we let 


a = 0.6, then 0 = 2.007548968 and the given equation is asymptotically 
stable if and only if —0.4 < b < 0.4477703541. 


5.2 Sufficient Conditions for Stability 


Clark [21] considered the equation 
u(n+k)+pe(n+k—1)+¢a(n) =0 (5.2.1) 
where p,q € R. When p = —1, we revert back to the Levin and May equa- 


tion (5.1.18). He showed that the zero solution of (5.2.1) is asymptotically 
stable if 


Ip] +a] < 1. (5.2.2) 
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Moreover, the zero solution is unstable if 
lp| — la| > 1. (5.2.3) 


Here we will extend Clark’s Theorem to the general equation (5.1.1). 
The novelty of Clark’s proof is the use of Rouché’s Theorem from Complex 
Analysis to locate the characteristic roots of the equation. In the first two 
editions of this book, I followed Clark’s proof. In this edition, I am going to 
deviate from this popular method, and give instead a simpler proof based 
on Gerschgorin’s Theorem [111] which we now state. 


Theorem 5.8. Let A be ak xk real or complex matrix. Let S; be the disk 
k 

in the complex plane with center at ai and radius r; = X, |ai;|. Then all 
j= 
jži 


k 
the eigenvalues of A lie in S = U Si. 
i=l 


PROOF. Let À be an eigenvalue of A with a corresponding eigenvector 
v = (v1, 02,-.-, Uk)” such that ||v||,, = max{|v,;|} = 1. (Why?). 
a 


k 
Since Av = Av, equating the ith row in both sides yields > a;jvj = Au. 
j=l 
Hence 


k 
(A — aji)vi = X. ijj, wa 2na Ka 
At 
Since ||v||o. = 1, there exists r, 1 < r < k, such that ||v||o. = |vr| = 1. 
Then 
k 
|A = arr| = (A — arr )vr| < 5 larg [lus] < rk 
jer 


so that À is in the disk S». 


The following example illustrates the above theorem. 


Example 5.9. Consider the difference equation 


n(n +3) + 52(n+2) — e(n +1) + 5a(n) =. (5.2.4) 


This equation can be converted to the system 
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A Imaginary axis 


Real axis 


FIGURE 5.2. Gerschgorin disks. 


This can be written in the compact form 


y(n) = (w1(n),#2(n), z3(n))", 
0 1 0 
ale- a 
ae a | 
-> i 


The eigenvalues of A are the characteristic roots of (5.2.4). By Ger- 
schgorin’s Theorem, all the eigenvalues of A lie in the union of the disks S4 
and S2, where Sj is the disk centered at the origin with radius 1 and Sə is 
centered at —4 and with radius } + 4 = % = 0.45 (Figure 5.2). Thus 
the spectral radius of A, p(A) < 1. In fact we can do better if we realize 
that an eigenvalue Ao of A is also a characteristic root of (5.2.4). Hence 
AG + ZAG — GAo + § = 0 or AB = —FAZt io- § = O. Now if Jo] = 1, 
1 = JA] < | — $A0l + |GA0] + | — $| = 58, a contradiction. Hence p(A) < 1. 
Thus by Corollary 2.24, the zero solution of (5.2.4) is asymptotically stable. 


Theorem 5.10. The zero solution of (5.1.1) is asymptotically stable if 


k 
S > [pil <1. (5.2.5) 
w=1 


PROOF. We first convert (5.1.1) into a system of first-order difference 
equations 


x(n +1) = Aaz(n) (5.2.6) 
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where 
0 0 0 
0 1 0 
A= J. (5.2.7) 
0 0 0 e 1 
—Pk —Pk-1 ~Pk-2 ‘t ~Pl 


By Gerschgorin’s Theorem all the eigenvalues lie in S1 U S2, where Sj is 
the unit disk, and S is the disk with center —p; and radius r = Sues Ipil. 
By assumption (5.2.5), |A| < 1. To eliminate the possibility that |A| = 1, 
we assume that A has an eigenvalue Ao such that |Ao| = 1. Now Ao is also a 
characteristic root of (5.1.1) and thus from (5.1.2), p(Ao) = AK + p1A5 T1 + 
+--+ pk = 0. This implies that 


1 = |AS] < |—piAg t+ |[-p2å6 °l ++ + [pal 


which leads to a contradiction. It follows by Corollary 2.24 that the zero 
solution (5.1.1) is asymptotically stable. 


A partial converse of this theorem may be obtained by a more refined 
statement of Gerschgorin’s Theorem. 


Theorem 5.11. Let S;, i = 1,2,...,k, be the Gerschgorin disks of a k x k 
matrix A. Suppose that for some 1 < m < k, (U; Si) N (aii Sı) =Í. 
Then there are exactly m eigenvalues (counting multiplicities) of A that lie 


in Ue, Si and k — m eigenvalues that lie in Cae, Si. 


PROOF. The proof may be found in [111]. 


We are now ready to provide the promised partial converse to Theorem 
5.10. 


Theorem 5.12. The zero solution of (5.1.1) is unstable if 


k 
[pı] — D Ipi] > 1. (5.2.8) 
i=2 


PROOF. We first convert (5.1.1) into system (5.2.6). Then by Ger- 
schgorin’s Theorem all the eigenvalues of A lie in the disks Sı and S2 
where Sı is the unit disk and Sù is the disk centered at —pı and with ra- 
dius r = )0*_, |p;|. Condition (5.2.8) implies that S1 N S2 = Ø. By Theorem 
5.11, S2 must contain an eigenvalue A; of A. Moreover, |A;| > 1. Hence the 
zero solution of (5.1.1) is unstable. 
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Exercises 5.1 and 5.2 


1. 


EG 


*8. 


*10. 


Show that the zero solution of a(n + 4) + piz(n + 3) + pox(n + 2) + 
p3a(n + 1) + paz(n) = 0 is asymptotically stable if and only if |p4| < 
1, |p3 + pil < 1+p2+pa, and |p2(1 — p4) +p4(1— p3) +1 (papi — p3)| < 
pap2(1 — pa) + (1 — pi) + ps(papı — ps). 


. Extend the result in Problem 1 to the fifth-order equation 


x(n+5)+pia(n+4)4+ pox(n+3)+p3e(n+2)+psx(n+1)+ps5z(n) = 0. 


. For what values of a is the zero solution of x(n + 3) — a(n + 2) + 


asl 


S— x(n) = 0 asymptotically stable? 


. Consider the equation a(n + k) — a(n + k — 1) + %*2(n) =0, k > 2. 


(i) Show that the zero solution is asymptotically stable if and only if 


(L) 1<a<1+ [Pes] E] / (1 2e0s | 7) )| ; 


(ii) Show that in (L) as k increases to oo, œ decreases monotonically 
to 1. 


. Prove that the zero solution of (5.1.37) is asymptotically stable if and 


only if the zero solution of (5.1.29) is asymptotically stable. 


. Apply Theorem 5.1 to show that the zero solution of the difference 


equation Az(n) = —qa(n — 1), q > 0, is asymptotically stable if and 
only if g < 1. 


(Hard). Prove that the zero solution of the difference equation Ar(n) = 
—qz(n —k),q >0,k > 1, is asymptotically stable if gk < 1. 


Consider the linear difference equation 
a(n+ 1) — a(n) + X piz(n — ki) =0, neZt, 
i=1 


P1, P2, ---;Pm E (0,00) and k1, k2,...,km are positive integers. Show 
that the zero solution is asymptotically stable if X5; kipi < 1. 


. Consider the difference equation 


a(n+1)—2(n) 4+ pa(n—k)—qa(n—m)=0, neZ, 


where k and m are nonnegative integers, p € (0,00), and q € [0, 00). 
Show that the zero solution is (globally) asymptotically stable if 


kp<1 and q<p(l—kp)/(1+kp). 


Consider the following model of haematopoiesis (blood cell production) 
[97], [78] 


p 
TTEN GR 


N(n+1)=aN(n) neZt 


? 
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and a € [0, 1), p, 8 € (0,00), k is a positive integer. Here N(n) denotes 
the density of mature cells in blood circulation. 
(a) Find the positive equilibrium point N*. 
(b) Show that N* is (locally) asymptotically stable if either: 
(i) p< 1; or 


P 


Pp 
(i) p> 1 and (725) < g: 


The following problems give Clark’s proof of Theorems 5.10 and 5.12. 
These proofs are based on Rouché’s Theorem from Complex Analysis 
[20]. 


Theorem 5.13 (Rouché’s Theorem). Suppose that: 


(i) two functions f(z) and g(z) are analytic inside and on a simple 
closed contour y in the complex domain, and 


(ii) | f(z)| > |g(z)| at each point on y. 


Then f(z) and f(z) + g(z) have the same number of zeros, counting 
multiplicities, inside y. 


11. Use Rouché’s Theorem to prove Theorem 5.10. 
12. Use Rouché’s Theorem to prove Theorem 5.12. 


5.3 Stability via Linearization 


Let I be a subset of the real line R. Then J” =I xIx---x IC R” is 
the product of m copies of I equipped with any of the norms 1/1, 12, or loo 
as discussed in Chapter 3. 

Now a function f : I” — I is continuous at x = (£1, %2,...,£m) if 
given € > 0, there exists ô > 0 such that if y = (y1, Y2,- --, Ym) € I” and 
\|~—y|| < 6, then | f(x)—f(y)| < £. Notice that the l1-norm gives ||z—y||, = 
ye lz: — yil. For the lg-norm, we have ||z — y|l2 = X; (£? — y?), and 
finally the /,.-norm gives ||x — y|loo = max |x; — yil. 

Following the work of Ladas and his collaborators [85] we will use the 


1;-norm, unless otherwise noted. 
Consider the following difference equation of order k + 1, 


a(n+1)= f(a(n), a(n — 1),... x(n — k)) (5.3.1) 
where f : [**+! — I is a continuous function. 
Given a set of (k + 1) initial conditions £-k, £-k+1,--., £o € I, there ex- 


ists a unique solution {x(n)}°°__, of (5.3.1) such that z(—k) = zg, 2(—k+ 
1) = w_p4i,---,2(0) = zo. Of course one may convert (5.3.1) to a 
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system of first-order difference equations of order k + 1 as follows. Let 
yi(n) = a(n —k),yo(n) = (x —k+1),...,ye4i(m) = x(n). Then (5.3.1) 
may be converted to the system 


y(n +1) = F(y(n)), (5.3.2) 


where 


y(n) F (yi(n), yo(n), scaler Yrti(n))”, 
F(y(n)) = (u(n), y(n), -yet (n), Flur (n) yal), yu(r))”. 


We may write F = (Fi, F,..., Fei)", where Fi(y1) = y2, Fo(y2) = 
Y3- -o Fk+1(Yk+1) = F(yetis---, Y1). 

A point «* € I is an equilibrium point of (5.3.1) if f(a*,a*,...,a*) = 
x*. This corresponds to the equilibrium point (2*,a*,...,2*) € R**+ fo 
system (5.3.2). Notions of stability of equilibrium points and periodic points 
of (5.3.1) may be stated via (5.3.2) and the use of proper interpretations 
of the notions in regards to (5.3.1). Here is a sample. 


Definition 5.14. An equilibrium point x* of (5.3.1) is stable (S) if, given 
€ > 0, there exists ô > 0 such that if {a(n)}°°_, is a solution of (5.3.1) 
with 


(\z(—k) — x*| + |2(—k +1) — 2*|+---+|x(0) — x*|) < 6, 


then 
|ja(n) -—a*|<e forall n> —k. 


Analogous definitions can be given for the remaining notions of stability 
as defined in Chapter 4. 
If f is continuously differentiable in some open neighborhood of X* = 


(a*,a*,...,a”*), then one can linearize (5.3.1) around X*. One way to do 
this is to revert to system (5.3.2) to obtain the linear system 
z(n +1) = Az(n), (5.3.3) 


where A is the Jacobian of F at X*, A = DF(X*). Then convert (5.3.3) 
to a scalar equation. However, one may also linearize (5.3.1) directly using 
the chain rule. Thus the linearized equation around «* is given by 


u(n + 1) = pou(n) + pru(n — 1) +--+ + pru(n — k), (5.3.4) 
where 
p= La, 2); 
with f(uo,u1,..., Uk). 


The characteristic equation of (5.3.4) is given by 
AETI — poA? — pi àT! + = pp = 0. (5.3.5) 
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Using the stability results in Chapter 4 for system (5.3.2), one may easily 
establish the following fundamental stability result. 


Theorem 5.15 (The Linearized Stability Result). Suppose that 
f is continuously differentiable on an open neighborhood G C R*+! of 
(a*,a*,...,”*), where x* is a fixed point of (5.3.1). Then the following 
statements hold true: 


(i) If all the characteristic roots of (5.3.5) lie inside the unit disk in the 


complex plane, then the equilibrium point x* of (5.3.1) is (locally) 
asymptotically stable. 


(ii) If at least one characteristic root of (5.3.5) is outside the unit disk in 
the complex plane, the equilibrium point x* is unstable. 


(iii) If one characteristic root of (5.3.5) is on the unit disk and all the 
other characteristic roots are either inside or on the unit disk, then the 
equilibrium point x* may be stable, unstable, or asymptotically stable. 


PROOF. The proofs of (i) and (ii) follow from Corollary 4.34 and Theorem 

4.38. 

(iii) This part may be proved by the following examples. First consider the 
logistic equation x(n + 1) = x(n)(1 — x(n)) = f(x(n)). The linearized 
equation around the equilibrium point «* = 0 is given by u(n + 1) = 
u(n) with the characteristic roots A = 1. But we know from Section 
1.6 that «* = 0 is unstable. 


Now we give an example that produces a different conclusion from the 
above example. Consider the equation 


x(n + 1) = a(n) —2°(n) = f(x(n)). 
The linearized equation is given by 
u(n + 1) = u(n) 


with the characteristic root A = 1. Now for the equilibrium point 
xv* = 0, we have f’(0) = 1, f”(0) = 0, f” (0) = —6 < 0. This implies 
by Theorem 1.15 that x* = 0 is asymptotically stable. 


Example 5.16 [15]. Consider the difference equation 
a(n +1) = az(n) + F(a(n — k)) (5.3.6) 


which models whale populations. Here x(n) represents the adult breeding 
population, a, 0 < a < 1, the survival coefficient, and F(a(n — k)) the 
recruitment to the adult stage with a delay of k years. The equilibrium 
point x* of (5.3.6) is given by the equation 


x* =ax* + F(a*), 
x* = F(x2*)/(1—a). (5.3.7) 
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Since F(a2*) = (1 — a)a*, (1 — a) is the annual mortality rate of the whale 
population. The linearized equation associated with (5.3.6) is given by 

u(n + 1) = au(n) + bu(n — k), (5.3.8) 


where b = F'(x*). 
Equation (5.3.8) may be written in the form 


u(n + 1) — au(n) — bu(n — k) = 0. (5.3.9) 


By Theorem 5.10, a sufficient condition for the zero solution of (5.3.9) 
to be asymptotically stable is 
Jal + |b] <1, 
a+ |b| <1. (5.3.10) 


Condition (5.3.10) is a sufficient condition for the asymptotic stability of 
the equilibrium point x* given by (5.3.7). 


Exercises 5.3 


1. Consider the delayed recruitment model 


a(n+1)= zrn) H F(a(n—k)). 


Let x* be the equilibrium point and let b = F’(a*). Assume that 
F is continuously differentiable in an open neighborhood of x*. Find 
sufficient conditions for x* to be asymptotically stable if: 


G) k=2, 
(ii) k=3. 
2. Consider the single species, age-structured population model 
x(n + 2) = x(n) exp(r — ax(n + 1) — x(n)), 
where x, > 0 for all n € Zt, a,r > 0. 
(i) Show that all solutions are bounded. 


(ii) Find conditions on r and a under which the positive equilibrium 
is asymptotically stable. 


In Subsection 4.7.5 we studied in detail the larval—pupal-adult (LPA) 
of the flour beetle. 


L(n + 1) = bA(n) exp(—cg,A(n) — cgr L(n)), 
P(n4+1)=(1- uL)L(n), (5.3.11) 
PA E E E E) 


Kuang and Cushing [83] considered the simplified case when larval 
cannibalism of eggs is not present, i.e., cgr = 0. Problems 3 though 5 
refer to this simplified model. 
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Prove that (5.3.11) reduces to 
x(n+1)—aza(n) — Ba(n— 2) exp(—ci a(n — 2) — cox(n)) = 0, (5.3.12) 


where a = 1— ua, B = b(1— uL), c1 = CEA, Co = Cpa, t(n) = A(n42), 
n> -—2. 


Then show that if a+ 6 < 1, equation (5.3.12) has only the trivial 
equilibrium zł = 0. Furthermore, if a+ 8 > 1, then (5.3.12) has two 
equilibria, xj = 0 and x3 > 0, with 2 = (1/c1 + c2) n(G/(1 — a)). 


. Show that the linearized equation of (5.3.12) around an equilibrium 


point x* is given by 


y(n + 1) — [a — Bezz“ exp{—(c1 + ca) 2" }]y(n) 
— B(1 — c1x*) exp{—(c1 + c2)a*}y(n — 2) = 0. 


. Prove that: 


(i) The trivial solution x} = 0 is asymptotically stable 
BEEN oe 
LA 
(ii) The positive equilibrium 23 = (1/cı + ce) In(G/(1 — a)) is 
asymptotically stable if and only if 
|A+ Bl) <1, |A-3B) <3, and B(B-—A)<1, (5.3.13) 


where 


B=(1-a) Rs (m=. i}. 


. Consider the difference equation N(n+ 1) — N(n) = N(n)[a +bN (n — 


k) — cN?(n —k)], n € Z+, where a,c € (0,00) and b € R, k € Zt. 
(a) Prove the equation has a unique positive equilibrium N*. 


(b) Show that N* is (locally) asymptotically stable if 


k 
N* V b2 + 4ac < 2 cos al : 


. Consider the rational difference equation 


k k 
x(n+1)= (e+e) 7 (+5 ra-0) ; 
i=0 i=0 


where k is a nonnegative integer, ao,a1,...,@x, bo, b1,- - -bp € [0, 00), 
a,b € (0,00), Xf oa; = 1 and B = Pf obi > 0. Find the pos- 
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itive equilibrium point «* of the equation. Then show that 2* is 
asymptotically stable if b > 1. 


Consider the rational difference equation 


x(n+1) = [a + ba(n)]/[A + x(n — k)], (5.3.14) 


n € Z*, a,b € (0,00), with a +b > 0, A € (0,00), and k is a positive 
integer. Problems 8, 9, and 10 refer to equation (5.3.14) with the above 
assumptions. 


8. (i) Show that if either a > 0 or a = 0 and b > A, equation (5.3.14) 
has a positive equilibrium zx*. Then find 2*. 


(ii) Show that x* is (locally) asymptotically stable if either b = 0 or 
a = 0 and 


T 
b>A>bd(1—2cos—— }. 
>A> ( cos yams z) 
9. Show that the positive equilibrium «* of equation (5.3.14) is asymp- 
totically stable if either k = 1 anda > 0 or k > 2 and A > 
b. 


*10. Show that for any positive solution x(n) of equation (5.3.14) there 
exists positive constants C and D such that C < a(n) < D, n € Zt 
provided that b > 1. 


5.4 Global Stability of Nonlinear Equations 


Results on global asymptotic stability are scarce and far from complete. In 
Chapter 4 we have seen how Liapunov functions can be used to establish 
both local and global asymptotic stability. In this section we will utilize 
the special nature of scalar equations to present a few results that can 
deal with several types of equations. Roughly speaking, we will be mainly 
concerned with “monotone” equations. A more general investigation on 
monotone discrete dynamical systems is beyond the scope of this book 
and the interested reader is referred to the work of Hal Smith [138]. More 
detailed expositions may also be found in Sedaghat [133], Kocic and Ladas 
[80], and Kulenovic and Ladas [85]. 
Consider the following difference equation of order (k + 1), 


s(n +1) = f(a(n), a(n -1),...,a(n—k)), (5.4.1) 


n € Z* and k > 1 is a positive integer. The main result in this section is 
due to Hautus and Bolis [65]. (See also Kocic and Ladas [80] and Kulenovic 
and Ladas [84].) 
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Theorem 5.17. Consider (5.4.1) with f € C(I**1,R), where I is an open 
interval in R and x* € I is an equilibrium point. Suppose that f satisfies 
the following assumptions: 


(i) f is nonincreasing in each of its arguments, i.e., if a < b, then 
Pes Giese EAS Crei Oy. ete) 
(ii) (u—2«*)[f(u,u,...,u) — u] < 0 for all u € I/{a*}. 


Then with initial values (x(0),2(—1),...,2(—k)) € I, we have x(n) € I 
forn > 0 and limp... x(n) = a*. 


PROOF. Condition (ii) ensures that «* is the only equilibrium point in J. 
For if y* € I is another equilibrium point, then (y* —x*)[f(y*,y*,...,y")— 
y*| = 0 which violates condition (ii). Let x(n) be a solution of (5.4.1) 
with x(0),2(-1),...,a(—k) € I. Set m = min{2*,7(0),...,a(—k)}, M = 
max{a*,2(0),...,2(—k)}. By condition (ii) and since m < x*, we have m < 
f(m,m,...,m). Moreover, by condition (i) we obtain f(m,m,...,m) < 
f(a(0),2(—1),...,a(—k)) = x(1). Thus m < f(m,m,...,m) < x(1). Sim- 
ilarly, one may show that x(1) < f(M,M,...,M) < M. By induction 
on n, it is easy to show that m < x(n) < M for all n > —k. In partic- 
ular, since [m, M] C I, it follows that x(n) € I, for all n > —k. Since 
x(n) is bounded, both limps inf x(n) = Lı and lim,_,.. sup a(n) = Lo 
exist. Furthermore, m < Lı < La < M. Let £ > 0 be sufficiently small 
such that [m + €,M +e] C I. There exists a positive integer N such 
that Lı — € < a(n — k) for all n > N. This implies by condition (i) that 
f(y — €, Lı — €,..., L1 — €) < f(a(n), a(n — 1),... x(n — k)) = a(n + 1), 
for all n > N. Consequently, f(Li — €, Li — €, . . . , L1 — €) < Ly. Since f is 
continuous, and € is arbitrary, it follows that f(Lı, Li,..., L1) < Lı. This 
implies by condition (ii) that x* < Lı. By a similar argument (Problem 
12). one may show that Lə < x* and, consequently, La < «* < Lı. Hence 
xv* = Lı = Lə, and limpo x(n) = 2*. 


Example 5.18. The Beverton—Holt model [10] 
B rKz(n) 

= K+(r—1)2(n)’ 
has been used to model populations of bottom-feeding fish, including the 
North Atlantic plaice and haddock. These species have very high fertility 
rates and very low survivorship to adulthood. Furthermore, recruitment is 
essentially unaffected by fishing. 

Local stability analysis (Theorem 1.13) reveals that: 


K>0, r>0, (5.4.2) 


a(n +1) 


(i) if 0 <r < 1, then the zero solution x} = 0 is asymptotically stable, 
(ii) if r > 1, then the equilibrium x73 = K is asymptotically stable. 


Using Theorem 5.17 one can say more about x3. Since f(x) =rKa/K+ 
(r — 1)x is monotonically increasing for r > 1, condition (i) in Theorem 
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5.17 holds. Now for any u € (0,00), 


OR K)( 


rKu-ulK +(r— Us) 


K+(r—1)u 
(K =u)? 
=a KGa 


and condition (ii) in Theorem 5.17 is satisfied. It follows that x3 = K is 
globally asymptotically stable. 

Cushing and Henson [26] used more elementary methods to prove the 
above results. 

Now consider the second-order (modified) Beverton—Holt model 
rK(aa(n) + Bx(n — 1)) 

K + (r—1)a(n—- 1) 
where r > 0, K > 0, anda+f=1. 

In this model, the future generation x(n + 1) depends not only on the 
present generation z(n) but also on the previous generation x(n — 1). This 
model has two equilibrium points as before xj = 0 and 73 = K. 

We first investigate the local stability of these two equilibria. Using 
Theorem 5.15, we have the following conclusions: 


a(n +1) = (5.4.3) 


(a) The zero solution zł = 0 of (5.4.3) is locally asymptotically stable if 
and only if0<r< 1. 


b) The equilibrium x35 = K is locally asymptotically stable if and only if 
2 y asy y y 
r>l. 


In fact, one can say more about x3 = K. Following the same analysis used 
for (5.4.2), one may conclude by employing Theorem 5.17 that «3 = K is in 
fact globally asymptotically stable. A higher-order Beverton-Holt equation 
has been investigated in [81]. 


The second result that we will present is of a different flavor. It is much 
more flexible than Theorem 5.17 since it allows f to be either nondecreas- 
ing or nonincreasing in its arguments. This leads to the notion of weak 
monotonicity. 


Definition 5.19. The function f(u1,u2,...,Uk+1) is said to be weakly 
monotonic if f is nondecreasing or nonincreasing in each of its arguments, 
i.e., for a given integer j, 1 < j <k+1, if a < b, then either 
fly---5G---,) <fC,...,0,-..,°) or 
Fp.. 5G, 06-5") a A EEE T 
where a and b are in the jth slot, and all the other slots are filled with fixed 


numbers 21, 22, ..., Zj—1; Zj- <; Zk+1 


Theorem 5.20 [60]. Suppose that f in (5.4.1) is continuous and weakly 
monotonic. Assume, in addition, that whenever (m, M) is a solution of the 
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system 
m = f(m1,m2,---,;Me41) and M = f(Mı, Mə,..., Mk+1), 
where, for each i = 1,2,...,k+ 1, 
m iff is nondecreasing in zi, 
Gi p if f is nonincreasing in ži, 
and 
i if f is nondecreasing in zi, 
M; = 
m iff is nonincreasing in zi, 


then m = M. 
Then (5.4.1) has a unique equilibrium point x* = m which is globally 
attracting. 


PROOF. Let m? = a, M? = b, and for each i = 1,2,... set 


M? = f(M?"1, Mit... , M7) 


k+1 
and 
m' = fi m os ea ama); 
where 
ð a if f is nondecreasing in the ith slot, 
m, = 
i b if f is nonincreasing in the 7th slot, 
and 
eo b if f is nondecreasing in the ith slot, 
‘la if f is nonincreasing in the 7th slot. 
For r > 0, 
e miT! if f is nondecreasing in the ith slot, 
mm, = 
í M7} if f is nonincreasing in the ith slot, 
and 
M= ’ 


r-1 


mM; 


M?! if f is nondecreasing in the ith slot, 
if f is nonincreasing in the ith slot. 


It follows from the assumptions on f that, for i > 0, 


mo <mi<-.-<mi<.--<Mi<.--<M'!< MP. 
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Furthermore, më < x(n) < M?* for n > 2i +1. Set m = lim; Mt and 
M = lim;4.. M’. Then M > limsup,_,,, 2(n) > liminf,,.. z(n) > m. 
Since f is continuous, it follows that m = f(m, M2,..., Mk+41) and M = 
f(Mı, Mo,..., Mk+1). Hence x* = m = M is the unique equilibrium point 
of (5.4.1). Moreover, limp... #(n) = 0 and the proof of the theorem is now 
complete. 


Example 5.21 [85]. Consider the difference equation 


py(n) + y(n = 1) + 
n+1)= > p>0, nez”. 5.4.4 
y(n + 1) P (5.4.4) 
This equation has only two fixed points yj = 0 and y3 = 1. Local stability 
analysis shows that y5 is locally asymptotically stable. Now assume that 
y(n) is a solution of (5.4.4), such that y(n) > 1 for all n € Z*. Then from 


(5.4.4) we have y(n + 1) — y(n) = (1— y(n)) 2&2; < 0. This implies 
that y(n) is nonincreasing and thus has a limit in [l1,oo). But this leads 
to a contradiction since 0 < y} < 1. Hence for some positive integer N, 
y(N) € (0,1). Writing (5.4.4) in the form 


y(n +1) —1= [y(n) — 1] 


a S 
p+y(n—1) 


we conclude that y(N +r) € (0,1) for all r € Z+. Now in the interval 
(0,1), the function f(u, v) = ee is increasing in both arguments and, by 
Theorem 5.20, y5 is globally asymptotically stable. 


The following corollary of Theorem 5.20 is easy to apply to establish the 
global asymptotic stability of the zero solution. 

An independent proof of this conclusion may be found in Grove et al. 
[61]. 


Corollary 5.22. Contemplate the difference equation 
k 
a(nt1) => 2(n-1)fi(a(n),a(n—1),...,2(n—k)), neZt, (5.4.5) 


with initial values x(0),x(—1),...,2(—k) € [0,00) such that 
(i) KE Zt; 

(ii) fo, fis- +, fe € C [[0,00)**, [0, 1)]; 

iii) fo, fi,..., fk are nonincreasing in each argument; 

iv) pan fi(uo,U1,..., Ux) < 1 for all (uo, 11, ..., up) E (0,00)*t?; 


(v) fo(u,u,...,u) >0 for all u > 0. 


( 
( 


Then the trivial solution x* = 0 of (5.4.5) is globally asymptotically stable. 


ProoF. This will be left as Exercises 5.4, Problem 13. 
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Example 5.23. Consider again (5.4.4). If p+ 1 < q, then yj = 0 is 
the only equilibrium point in [0,co). By Theorem 5.15, yf = 0 is locally 
asymptotically stable. Now we write (5.4.4) in the form 

1 


“q+y(n—1)’ 


y(n +1) = y(n); + y(n —1) 


p 
q+y(n—1) 


Hence 


filu, v) = : 


fo(u,v) = a rg 


qtv’ 


It is easy to show that fo and fı satisfy all the conditions (i) through (iv) in 
Corollary 5.22. Hence by Corollary 5.22, yj = 0 is globally asymptotically 
stable. 


Exercise 5.4 


1. Consider a modified Beverton—Holt equation 


_ rK(az(n) + Ba(n —1)) 
K+(r—1)a(n—-1) ’ 


a+@=1, a,ß >00. 
Show that the zero solution is globally asymptotically stable if 0 < r < 
1. 


2. Show that the zero solution of the equation a(n +1) = aa(n — 
k) exp[—b(x?(n) + +++ + x?(n — m))], Jal < 1, b > 0, is globally 
asymptotically stable. 


3. Consider the LPA model of the flour beetle (5.3.11) with no larval 
cannibalism on eggs: 


a(n+1) = ax(n) + Ba(n — 2) exp[—cia(n — 2) — coa(n)] 


where a = 1— ua, B = b(1— uL), c1 = CEA, Co = Cpa, t(n) = A(n42). 
Show that the zero solution is globally asymptotically stable ifa+ 6 < 
l and 8 > 0. 


4. The following equation describes the growth of a mosquito population: 
a(n + 1) = (aa(n) + ba(n — L)e~*™"V)e“*™™ | ne Zt, 


where a € (0,1), b € [0,co). Prove that the zero solution is globally 
asymptotically stable if a+b < 1. 


5. A variation of the mosquito model in Problem 4 is given by the 
equation 


a(n +1) = (aa(n) + ba(n—1))e"*™, nezZ*, (5.4.6) 


where a € [0,1), b € (0,00). Prove that the zero solution is globally 
asymptotically stable ifa+b6<1andb6< 1. 


= 


6. 


10. 


11. 


12. 
13. 
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Show that the positive equilibrium of the equation 
p+qu(n— 1) 
1) = —_—__—.,, p,q >), 
a(n +1) 1+ x(n) Pq 


is globally asymptotically stable if q < 1. 


. Show that the positive equilibrium of the equation 


pt+a(n—-1) 
qa(n) + a(n- 1)’ 
is globally asymptotically stable if q < 1+ 4p. 


zr(n+1)= p,q > 0, 


. Consider equation (5.4.4). Show that if y(—1)+y(0) > 0 and p+1 >q, 


then the positive equilibrium y* = p+ 1 — q is globally asymptotically 
stable. 


. Consider the equation 


a(n) +p 
x(n) + ga(n — 1)’ 


a(n+1)= p,q>0, neZr. 


Show that the positive equilibrium point of the equation is globally 
asymptotically stable if q < 1 + 4p. 


Show that the positive equilibrium point of the equation 
p+ qu(n) + 
1) = ————.., p,q> 0, EL"; 
x(n + 1) 1+a(n—1) p,q n 


is globally asymptotically stable if one of the following two conditions 
holds: 


(i) q <1, 
(ii) q > 1 and either p < qor q < p < 2(q + 1). 
Show that the positive equilibrium of the equation 


a(n +1) ERN, pq>0, nezt, 


is globally asymptotically stable if q < pq + 1 + 3p and p < q. 


Complete the proof of the Theorem 5.17 by showing that Lo < x*. 


Prove Corollary 5.22. 


*14. (Term project). Consider equation (5.4.6) with the assumption a+b > 


1 and b < <4 (where e” is the exponential function). Show that the 
positive equilibrium is globally asymptotically stable, with basin of 


attraction [0,00) x [0,00)/{(0, 0)}. 


‘Problems 6-11 are from Kulenovic and Ladas [85]. 
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*15. Conjecture [85]. Prove that every positive solution of the equation 
a+ Bx(n) + ya(n— 1) 
ca(n — 1) : 


where n € Zt, ac > 0, converges to the positive equilibrium of the 
equation. 


a(n+1)= 


*16. Conjecture [85]. Consider the equation 
a+ ya(n—1) 


t 1 = ’ 
P A+ Bz(n)+Czr(n-— 1) 
where qa, y, A, B,C > 0. Prove that if the equation has no solutions of 
prime period 2, then the positive equilibrium is globally asymptotically 
stable. 


(Open Problems: Kulenovic and Ladas.) Assume that p,q,r € [0,00), 
k > 2 is a positive integer. Investigate the global stability of the following 
equations. 


Mradi 


A = n—k 
18. y(n +1) = See ay 


* — _Pyln) +yln =k) 
-yn tD = p ayat ue BY 


5.5 Applications 


5.5.1 Flour Beetles 


In this section we consider again the LPA model [83] of the flour beetle 
(5.3.12) with no larval cannibalism on eggs: 


x(n +1) = az(n) + Br(n — 2) exp|—ciz(n — 2) — cx (n)] 
= f(x(n), a(n — 1), x(n — 2)) (5.5.1) 


where a = 1 — ua, B = b(1 — uL), C1 = CEA, Co = Cpa, t(n) = A(n + 2). 
Using the Schur—Cohn Criterion one may show that the positive equilib- 


rium zš = R n (4) is (locally) asymptotically stable if and only if 
the following conditions hold: 

|A+B|<1, |A-3B)<3, B(B-—A)<1, (5.5.2) 
where 


4=20—2) (m2 ) a, B=(1 a)l 1 (1m £ ) i}. 
1+ C2 a C1 + C2 l-a 
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In the sequel, we will go one step further and prove that the equilib- 
rium point x3 is in fact globally asymptotically stable under the following 
assumptions: 
Ayj:a+@6>1 and 8< min{e(1 — qa), eacı/c2}, 
Ap : max{x(—2),2(—1), x(0)} > 0. 
The following two lemmas from Kuang and Cushing [83] will facilitate 
the proof of the main result and make it more transparent. 


Lemma 5.24. Ifa+ (> 1, then 


lim sup x(n) < k (5.5.3) 


nao cell — a) 
PROOF. Consider the function h(x) = ciexe™®®. This function has a 
critical point £e, where 


, i= Qe. As 
h (te = cje Te cjaee He = 0. 


Hence ze = Z and h (2) = 1 is the maximum value of h. It follows that 


—C12 


cy exe < 1 and, consequently, 


1 
se 1" < —, (5.5.4) 
CLE 
Going back to equation (5.5.1) we obtain 


x(n +1) < ax(n) + Br(n — 2) exp(—ci x(n — 2)) 


Borys ene ay (5.5.5) 
Cie 
By (1.2.8), the solution of (5.5.5) is given by 
p 
<a” l-a” 
a(n) < a”x(0) selca a”) 
and since a € (0,1), it follows that 
p 


lim sup z(n) < 


n= cie(1 m a) í 
The next lemma shows that (5.5.1) satisfies condition (ii) in Theorem 
5.17. 


Lemma 5.25. For any u >Q, u Æ z3, 
(u — x3)[f(u, u, u) — u] < 0. (5.5.6) 
PROOF. Let g(u) = f(u, u,ur)— u. Then 


glu) = ula + Bexp(—(cı + c2)u) — 1]. 


Clearly g(u) = 0 if and only if u = 0 or u = x3. We now have two cases to 
consider. 
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Case (a): If 0 < u < z3 = ate In (+4). then 


a+ Bexp[—(c1 + c2)u] — 1 >a + Be~ (er te2)a2 —1=0, 
and (5.5.6) holds true. 
Case (b): If u > x3, then 
a+ Bexp[—(c1 + c2)u] — 1 < a+ Bexp[—(c1 + c2) x5] — 1 = 0, 
and (5.5.6) holds true. 


We are now ready to prove the following theorem. 
Theorem 5.26. If conditions A, and Ag hold, then 
Jim, x(n) = z3. 
PROOF. By virtue of Lemma 5.25 it remains to show that condition (ii) 


ot Theorem 5.17 holds. To accomplish this task we need to show that 
Belay Tanai)? roe J Ž 0 on a region D. Simple computations show that 


Of | 
aC) > — c23x(n — 2) exp[—ci x(n — 2) — cox(n)], 
Of 
FE aes 
fe 2) = B(1 — ca(n — 2)) exp[—ci x(n — 2) — c2z(n)]. 


Now by Lemma 5.24, limsup,_,,, (Nn) < 8[cie(1 — a)]~+. Since 8 < e(1 — 
a), this implies that limsup,,_,,, < me Hence, for n > N, for some integer 
N greater than 2, x(n — 2) < +. Let I = (0, £) and D = I?. Then z3 € I 
and zey > 0 fori = 1,2. Poono pets) > a — @fexp(—ca2(n — 
2)) >a- cl > 0. This shows that f is nondecreasing in each of its 
arguments restricted to D. Since max{z(—2),x(—1), x(0)} > 0, there is no 
such that for n > no, 0 < z(n—2) < oa Let #(0) = x(no), ĉ&(—1) = x(n9 — 
1), ĉ(—2) = x(no —2). Then since the equation is autonomous, ĉ(n) = x(n) 
for n > no. By Theorem 5.17, we have limp... 4(n) = z3. 


5.5.2 A Mosquito Model 
Consider the following mosquito model [61] 
x(n +1) = [ax(n) + ba(n — 1) exp(—a(n — 1))] exp(—2(n)), (5.5.7) 
where 
€(0,1), be([0,œ), nez”. 


This equation describes the growth of a mosquito population. Mosquitoes 
lay eggs, some of which hatch as soon as conditions are favorable, while 
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others remain dormant for a year or two. In this model, it is assumed that 
eggs are dormant for one year at most. 

Clearly x} = 0 is an equilibrium point. The positive equilibrium point 
may be obtained by solving the equation 

(a+be~*)e~* =1. 
Let g(x) = (a+ be~*)e~* — 1. Then since g'(x) = —e~*[a+ 2be~*] < 0 and 
g(0) =a +b- 1, a positive root of g exists if and only if 
a+b>1. (5.5.8) 


Moreover, the positive equilibrium point is given by 


x ( + va? + z) 
n=l | ————— j 
2 
Note also that if x(n) is a solution of (5.5.7) with z(—1) + x(0) > 0, then 


x(n) >0 foral n > 1. 
Our main objective in this subsection is to prove the following result. 


Theorem 5.27. Suppose that 


(e-a) 


E EE 
a+1 


Then the positive equilibrium x3 of (5.5.7) is globally asymptotically stable 
whose basin of attraction is (0,00). 


(5.5.9) 


ProoF. The proof is divided into two parts. The first part establishes lo- 
cal asymptotic stability and the second part establishes global attractivity. 
Here we denote #3 by x”. 


Part I: Local stability analysis. 
By criterion (5.1.9), it follows that the equilibrium point 23 is locally 
asymptotically stable if and only if the following three inequalities hold: 


bate ae ge arte be, (5.5.10) 
ae?” —ax*e® — br* < e —b+ba*, (5.5.11) 
ieee. (5.5.12) 


Observe that x* satisfies the equation 


* 


a* = (ax* + br*e® )e® 
or, equivalently, if x5 4 0, 
er" = ae™ +b. (5.5.13) 
Inequality (5.5.11) is satisfied since by using (5.5.13) we obtain 


e2*" _ b+ 2br* + ax*e* —ae® = 2br* +azr*e™ > 0. 
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Inequalities (5.5.10) and (5.5.12) both hold using (5.5.13) if 0 < a* < 2. 
But this is true in general for any positive solution x(n) since from (5.5.7) 
it follows that 
b a+b 


a(n+1) < az(n)e™®™ + ba(n — 1)e7®®) < Spe . 
e e e 


(Why?) (The function = attains its maximum at z = 1.) But by assump- 


tion (5.5.9), b < eea < e—a, and so 4 < 1. Hence x* < 2 and q* is 
thus locally asymptotically stable. 
Part II: Global attractivity. 
We set I = (0, =) and D = I xI and let our function be f : D > (0,00) 
defined as 
f(u, v) = (au + bve” )je™”. 


Then clearly x* € I. 
Now 2£(u,v) = bev Sve") > 0 since v > ve~” is increasing on [0, 1]. 


Ov ð 
Hence f is nondecreasing in v for v € I. Moreover, 
o 
°S u, v) = e” (a — au — bve”) > 0 
v 


if (au + bve™”) < a for all u,v € (0, 8). But 


ey (=) b 
au + bve” <a + - 


a?(a+1)+a?(e—a) +a(e—a) = 
= e(a+ 1) 


Hence f is nondecreasing in u, for u € I. 

This shows that condition (i) in Theorem 5.17 is fulfilled. Condition (ii) 
in Theorem 5.17 can easily be established and will be left to the reader to 
verify. The proof of the theorem is now complete. 


6 


The Z-Transform Method and 
Volterra Difference Equations 


In the last five chapters we used the so-called time domain analysis. In 
this approach we investigate difference equations as they are, that is, with- 
out transforming them into another domain. We either find solutions of 
the difference equations or provide information about their qualitative 
behavior. 

An alternative approach will be developed in this chapter. The new ap- 
proach is commonly known as the transform method. By using a suitable 
transform, one may reduce the study of a linear difference or differen- 
tial equation to an examination of an associated complex function. For 
example, the Laplace transform method is widely used in solving and an- 
alyzing linear differential equations and continuous control systems, while 
the Z-transform method is most suitable for linear difference equations 
and discrete systems. It is widely used in the analysis and design of digital 
control, communication, and signal processing. 

The Z-transform technique is not new and may be traced back to De 
Moivre around the year 1730. In fact, De Moivre introduced the more 
general concept of “generating functions” to probability theory. 
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6.1 Definitions and Examples 


The Z-transform of a sequence x(n), which is identically zero for negative 
integers n (i.e., x(n) = 0 for n = —1,—2,...), is defined by 


#(z) = Z(a(n)) = 2 a(j)z, (6.1.1) 


where z is a complex number. 

The set of numbers z in the complex plane for which series (6.1.1) con- 
verges is called the region of convergence of 2(z). The most commonly used 
method to find the region of convergence of the series (6.1.1) is the ratio 
test. Suppose that 


Then by the ratio test, the infinite series (6.1.1) converges if 
xa(j+1)z27-1 


- <1 
t(j)z9 


and diverges if 


Hence the series (6.1.1) converges in the region |z| > R and diverges for 
|z| < R. This is depicted in Figure 6.1, where Re z denotes the real axis 
and Im z represents the imaginary axis. 

The number R is called the radius of convergence of series (6.1.1). If R= 
0, the Z-transform Z%(z) converges everywhere with the possible exception 
of the origin. On the other hand, if R = oo, the Z-transform diverges 
everywhere. 

We now compute the Z-transform of some elementary functions. 


Example 6.1. Find the Z-transform of the sequence {a”}, for a fixed real 
number a, and its region of convergence. 


Solution Z(a”) = Soa, The radius of convergence R of Z(a”) is given 


j=0 
by 
J 
R= lim a |= lal 
Joo a 
Hence (Figure 6.2) 
X sani 1 z 
Z(a") = ( ) = = f 6.1.2 
=(= a i> (613 
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Region of 
convergence 


Region of 
divergence 


FIGURE 6.1. Regions of convergence and divergence for (z). 


Imz 
7X 


Region of 
convergence 


Region of 


lal 


divergence 


FIGURE 6.2. Regions of convergence and divergence for Z(a”). 


A special case of the above result is that of a = 1. In this case we have 


Z(1) = = for |z| > 1. 


Example 6.2. Find the Z-transform of the sequences {na"} and {n?a"}. 


Solution Recall that an infinite series Z(a”) may be differentiated, term by 
term, any number of times in its region of convergence [20]. Now, 


ier? = fo |z| > lal. 
(2—a) 

j=0 
Taking the derivative of both sides yields 


CO 


X -jaiz ee = — for |z| > |al. 
2 =a) 
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Hence 
Z(na”) = Sees = -zX —jaiz i", 
j=0 j=0 
Therefore, 
a az 


Again taking the derivative of both sides of the identity 
= az 
X jaiz = ———., for |z| > |a| 
= (z — a)? 


yields 


az(z +a) 
(z = a)? 


Example 6.3. The unit impulse sequence, or the Kronecker delta sequence, 


is defined by 
1 ifn= k, 
ôk(n) = À 
0 ifnÆk. 


Z(n7a") = for |z| > Jal. (6.1.4) 


The Z-transform of this function is 
Zi = XO ae ae. 
j=0 


If k = 0, we have the important special case 
Z(do(n)) = 1. (6.1.5) 
Notice that the radius of convergence of Z(6,(n)) is R = 0. 


Example 6.4. Find the Z-transform of the sequence {sin(wn)}. 


Solution Recall that the Euler identity gives et? = cos @+isin 0 for any real 
number 9. Hence e~*? = cos 6 — isin 0. Both identities yield 
i0 | o—ið i0 1 o—ið 
pa N and sing = aa 
2 2i 


Thus 
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Using formula (6.1.2) we obtain 


Z(sinwn) = > = Z for |z| >1 

2i |z- et z—e wv 

O zsinw 

~ (z—e®)(z— e-#) 

O zsinw 

~ g2 (e aL e-@)z41’ 

or 
Z(sinwn) = ae for |z| > 1. (6.1.6) 


z2 — 2zcosw + 1 


6.1.1 Properties of the Z-Transform 


We now establish some useful properties of the Z-transform that will be 
needed in the sequel. 
(i) Linearity. 
Let (z) be the Z-transform of x(n) with radius of convergence Rj, 
and let 9(z) be the Z-transform of y(n) with radius of convergence Ro. 
Then for any complex numbers a, 8 we have 


Z[ax(n) + By(n)| = a&(z) + By(z) for |z| > max(R1, R2). (6.1.7) 


The proof of property (6.1.7) is left to the reader as Exercises 6.1, 
Problem 18. 


(ii) Shifting. Let R be the radius of convergence of Z(z). 
(a) Right-shifting: If x(—7) = 0 for i = 1,2,...,k, then 


Z|x(n — k) = z~*%(z) for |z| > R. (6.1.8) 
(b) Left-shifting: 
koi 
Z[a(n + k)] = 2"2(2)— X a(r)" for |z| > R.| (6.1.9) 
r=0 


The proofs are left as Exercises 6.1, Problem 16. The most commonly 
used cases of formula (6.1.9) are 


Zla(n + 1)] = 2@(z) — zx(0) for |z| >R, 
Zje(n + 2)] = 27#(z) — z?x(0) — za(1) for |z| > R. 


— 


(iii) Initial and final value. 


(a) Initial value theorem: 


lim (z) = x(0). (6.1.10) 
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(b) Final value theorem: 


x(oo) = lim x(n) = lim(z — 1)%(z). (6.1.11) 


n—> oo Z—1 


The proof of formula (6.1.10) follows immediately from the definition 
of (z). To prove formula (6.1.11) we first observe that 


Z{2(n +1) — 2(n)] = S [eG +1) — ae. 
j=0 


Using formula (6.1.9) on the left-hand side of the above identity leads 
to 


(z = (2) = za(0) + X [e + 1) — a2. 
Thus 


lim (z — 1)@(z) = x(0) + dle +1) —2(j)] = lim 2(n). 


zl 


Convolution. 
The convolution* of two sequences x(n), y(n) is defined by 


n 


w(n) * y(n) = D9 a(n — jG) = X 2(n)y(n — j). 


j=0 j=0 


Now 


Zla(n) * y(m)] = X | do em- iju e. 
m=0 | 7=0 


Interchanging the summation signs yields 


And if we put m — i = s, we obtain 


Zla(n) * y(n)] = uae (> T , 


s=0 


Zjæ(n)* y(n)] = &(z)y(z). (6.1.12) 
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It is interesting to know that one may obtain formula (6.1.12) if the 
convolution is defined as 


(v) Multiplication by a” property. 
Suppose that (z) is the Z-transform of x(n) with radius of 
convergence R. Then 


Zla"x(n)| =% (=) 


a 


for |z| > |a|R. (6.1.13) 


The proof of (6.1.13) follows easily from the definition and will be left 
to the reader as Exercises 6.1, Problem 19. 


Example 6.5. Determine the Z-transform of 
g(n) =a"sinwn, n=0,1,2,.... 
Using Example 6.4 and formula (6.1.13) we have 


(z/a) sinw 
(z/a)? — 2(z/a) cosw +1 
az sinw 


~ 2az cosw + a2’ for |z| > Jal. (6.1.14) 


glz) = Z(a” sinwn) = 


(vi) Multiplication by n*. 
In Example 6.2 it was shown that Z(na") = EEO which may be 
written in the form 


Z(na”) = —z—Z(a"). 


dz 
Similarly, formula (6.1.4) may be written in the form 


Generally speaking, we write 


(4) 2) = ( et (= (e (a) 


It may be shown (Exercises 6.1, Problem 7) that 


k 
Z[n*x(n)] = (--2) Z(x(n)). (6.1.15) 
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Exercises 6.1 


1. Find the Z-transform and its region of convergence of the given 
sequence {a(n)}. 


(a) coswn. (b)nsin 2n. (c)n. 
2. Find the Z-transform and its region of convergence of the sequence 
1 for n =1,3,5, 
a-f 
0 forall other values of n. 
3. Find the Z-transform and its region of convergence of the sequence 
0 for n = 0, —1, —2,..., 
f(n)=4-1 forn=1, 
a” forn=2,3,4,.... 


4. Let x(n) be a periodic sequence of period N, i.e., a(n + N) = x(n) for 
all n € Z*. Prove that £(z) = [z"/(z" — 1)]%1(z) for |z| > 1, where 
Z1(z) = ey x(j)z~4(%1)(z) is called the Z-transform of the first 
period. 


5. Determine the Z-transform of the periodic sequence shown in Figure 
6.3. 


6. Use Problem 4 to find the Z-transform and its radius of convergence 
for the periodic sequence of period 4 


f(n) = 


1 for n = 0,1, 
—1 forn=2,3. 


7. Let R be the radius of convergence of (z). Show that 


Z[n®x(n)] = (22) a for |z| > R. 


N 


FIGURE 6.3. A periodic sequence. 


10. 
11. 


12. 
13. 
14. 


15. 
16. 
17. 


18. 
19. 


20. 


21. 
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. Prove that the Z-transform of the sequence 


(n—Da™?, n=0,1,2,..., 
x(n) = : 
0 n = -—1,-2,..., 


is @(z) = z4 for |z| > Jal. 


. Find the Z-transform and its region of convergence of the sequence 


defined by 


-1 —2 
M PER E eth os 
x(n) = 2 
0 n = —1,-2,.... 


The first backward difference for a sequence x(n) is defined by Va(n) = 
x(n) — «(n— 1). 


Find Z[V2(n)], Z[V22(n)]. 

Generalize the results of Problem 10 and show that Z[V*x(n)] = 
(23) a9. 

Find Z[Ax(n)], Z[A2a(n)]. 


Show that Z[A*x(n)] = (z — 1)¥#(z) — DD (z — 1)*-I-1Asx(0). 


Let y(n) = X}; z(i), n € Z+. Show that 9(z) = ~-{2(z) for |z| > 
). 


z—1 
max{1, R}, where R is the radius of convergence of (z 


2 


Let y(n) = $; o iz(i). Prove that 9(z) = =, £2(z). 
Prove formulas (6.1.8) and (6.1.9). 

Find the Z-transform of: 

(a) 2(n) = E? o a7" sin(wr). 

(b) Np cosw(n— r). 

Prove expression (6.1.7). 


Show that Z[a"x(n)] = (2) for |z| > |a|R, where R is the radius of 
convergence of %(z). 


Find the Z-transform and its radius of convergence of the sequence 
g(n) = a” cos(wn). 


Use the initial value theorem to determine x(0) for the sequence {x(n) } 
whose Z-transform is given by: 


(a) 4, for |z| >a. 


(b) 3 for |z| > 3. 


z—6? 
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22. Extend the initial value theorem to finding x(1), (2) by proving: 
() 2(1) = tim [2(@(2) — 2(0))) 
(ii) #(2) = lim [z(&(z) — zx(0) — x(1))]. 


|z| 00 


6.2 The Inverse Z-Transform and Solutions 
of Difference Equations 


As we have mentioned in the introduction to this chapter, the Z-transform 
transforms a difference equation of an unknown sequence x(n) into an 
algebraic equation in its Z-transform (z). The sequence x(n) is then ob- 
tained from Z(z) by a process called the inverse Z-transform. This process 
is symbolically denoted by 


Z~[#(z)] = x(n). (6.2.1) 
The uniqueness of the inverse Z-transform may be established as follows: 


Suppose that there are two sequences x(n), y(n) with the same Z-transform, 
that is, 


X r(i)z™ = DVORE for |z| > R. 
0 1=0 
Then 
Xei -yli =0, for |z| > R. 
1=0 


It follows from Laurent’s theorem [20] that a(n) = y(n). The most 
commonly used methods for obtaining the inverse Z-transform are: 


1. power series method; 
2. partial fractions method; 
3. inversion integral method. 


It is imperative to remind the reader that when finding the inverse Z- 
transform, it is always assumed that for any sequence x(n), z(k) = 0 for k = 
a, ee en 


6.2.1 The Power Series Method 


In this method we obtain the inverse Z-transform by simply expanding 
(z) into an infinite power series in z~* in its region of convergence: 
T(z) = J co a2" for |z| > R. Then by comparing this with Z[x(n)] = 
Xo z(i)z™ for |z| > R, one concludes that x(n) = an, n =0,1,2,.... 
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If £(z) is given in the form of a rational function (z) = g(z)/h(z), where 
g(z) and h(z) are polynomials in z, then we simply divide g(z) by h(z) to 
obtain a power series expansion (z) in z~'. The only possible drawback 
of this method is that it does not provide us with a closed-form expression 
of a(n). 


Example 6.6. Obtain the inverse Z-transform of 
E z(z+ 1) 
(z) = G-I =I 


Solution We first write x(z) as a ratio of two polynomials in 27t: 


5 EE 
~ Y= 2Qz-1 4 2-2" 


#(z) 


Dividing the numerator by the denominator, we have 


a(z) =1—327) +527? +7273 +9274 +1125 +- 


6.2.2 The Partial Fractions Method 


This method is used when the Z-transform Z(z) is a rational function in z, 
analytic at oo, such as 


| boz™ + biz t +++ + bm-12 + bm 
eM 4 ay 2Ml pees an2 bn 


X(z) >, men. (6.2.2) 


If (z) in expression (6.2.2) is expressed by a partial fraction expression, 
&(z) = ¥1(z) + Fo(z) + %3(z) +, 
then by the linearity of the inverse Z-transform one obtains 
w(n) = Z~*[%1(z)] + Z~*[¥a(z)] + Z-"[Za(z)] + 


Then a Z-transform table (Table 6.1; see the end of this chapter) is used 
to find 4 ee) i = 1,2,3,.... 

Before giving some examples to illustrate this method we remind the 
reader that the zeros of the numerator of expression (6.2.2) are called zeros 


of (z), and zeros of the denominator of expression (6.2.2) are called poles 
of &(z). 


Remark: Since Z(z) is often an improper fraction, it is more convenient to 
expand £(z)/z rather than (z) into sums of partial fractions. 
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Example 6.7. Simple Poles 
Solve the difference equation 

u(n+2)+32(n+1)+2a(n)=0, 2(0)=1, «(1) = —4. 
Solution Taking the Z-transform of both sides of the equation, we get 


-—1 
Cs ae 
(z+ 1)(z4 2) 
We expand “(z)/z into partial fractions as follows: 
F B (z-— 1) _ 4 | & 
DO) 2 =. ee ones ea), Casal z+? 


Clearing fractions, we obtain 


z—1= a(z +2)+a(z +1). 


This reduces to 


z— 1 = (a; + a2)z + (2aı + a2). 
Comparing coefficients of like powers of z, we get 


a, T 42 = 1, 


2aı T a2 = —1. 
Hence a, = —2, a2 = 3. Consequently, 
(2) —2z $ 3z 
z(z) = — + —. 
z+1 z+2 


Thus 
x(n) = —2(—1)” + 3(-2)”. 
Remark: If £(z) has a large number of poles, a computer may be needed to 
determine the constants aj,d2,.... 
Example 6.8. Repeated Poles 
Solve the difference equation 
a(n + 4) + 9x(n + 3) + 30a(n + 2) + 44r(n + 1) + 242(n) = 0, 
x(0)=0, «(1)=0, 2(2)=1, 2(3) = 10. 


Solution Taking the Z-transform, we get 
s z(z— 1) 
lz) = — A. 
(2) (z+ 2)3(z +3) 
It is convenient here to expand #(z)/z into partial fractions as follows: 
z= b ay a2 a3 


Wee Some a) ar e a De ee 


(6.2.3) 
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This time we use a smarter method to find a1, a2,a3, and a4. To find b we 
multiply (6.2.3) by (z +3) and then evaluate at z = —3. This gives 


ee" ee 
(2+ 2)? |,. 3 
To find a; we multiply (6.2.3) by (z + 2)? to get 
z—-1 (z + 2)8 
= + 2)? 4 +2)+a,+4 6.2.4 
z133 7 8 +2)" + alz +2) +a aay (6.2.4) 
and evaluate at z = —2. This gives 
z-1 
Ce ees Əyani 
To find ag we differentiate (6.2.4) with respect to z to get 
4 r(2z+7)(z+ 2)? 
— ss = 2 2 6.2.5 
G43 a3(z +2) + a2 (+3) ( ) 
and again evaluate at z = —2. This gives 
d fz-1 
pes =4. 
= de (5) Jaky 


Finally, to find a3 we differentiate (6.2.5) to obtain 


—8 d? (z +2) 
= 2a3 ’ 
(z +3)3 dz? (z+3) 
and if we let z = —2, then we have 
o1 d /z—1 EO 
BT oar AN etala 
Hence 
—4z 4z 3z 4z 


moe T e Cr eas 
The corresponding sequence is (Table 6.1, at the end of this chapter) 


2(n) = —4(—2)" — 2n(—2)" + Šn(n — 1)(-2)" + 4(—3)” 


= (Ge on a) 2)" 4 4(—3)", 


Remark: The procedure used to obtain a;,a2, and ag in the preceding 
example can be generalized. If #(z)/z has a pole of multiplicity m at z = 
zo, then the corresponding terms in the partial fraction expansion can be 
written 
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and a1,@2,..-,@m can be found using the formula 
1 d"t m (z) 
Con (r — 1)! dz"=t | 20) a ee 


Example 6.9. Complex Poles 
Solve the difference equation 

a(n+3)—a(n+2)+22(n)=0, 2(0)=1, (1)=1. 
Solution Taking the Z-transform of the equation, we get 


z3 


se eet Eye e 


Next we expand %(z)/z as a sum of the partial fraction in the form 


z2 ay ag i 


a3 


WINE aed). =e) b=-l etm: 


Using the method of the preceding example we obtain 


_ z? l 
OLE OO ink ee 
2 1 2 1. 
ai = = =-— zi, 
© P-a- 2+ 5 5 
== SNe 
a2 == pi 
Hence 
r _ 57 VARA i ız 
ET Soy 
where A = 1 + i. Thus 
1 2 
x(n) = 5(-1)" + aà” + a”. 


But 
a NT 
aA” + GA” = 2 Re(a A”) = 2|a1|(V2)" cos (+ + arg ai) l 


where |ai| = ¿v5 and arg a; = tan™+ (4) = 0.46 radians. Thus 


x(n) = =(-1)" + Z V5(V2)" cos (+ + 0.46) 
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6.2.3. The Inversion Integral Method! 


From the definition of the Z-transform, we have 


X(z) = x(i)z—*. 
i=0 
Multiplying both sides of the above equation by z”~', we get 
&(z)z"—" = 5 MOA 
i=0 
= (0) t + (1)? +--+ e(n)! + a(n +1)? +. 

(6.2.6) 

Equation (6.2.6) gives the Laurent series expansion of ț(z)z”7} around 


z=0. 

Consider a circle C, centered at the origin of the z-plane, that encloses 
all poles of Z(z)z"~1. Since x(n) is the coefficient of 27t}, it follows by the 
Cauchy integral formula [20] that 


x(n) = Le paler dz, (6.2.7) 


Oni 


and by the residue theorem [20] we obtain 
a(n) = sum of residues of &(z)2"~". (6.2.8) 
Suppose that 
h(z) 
g(z) 


In evaluating the residues of #(z)z"~1+, there are two cases to consider: 


G22 = 


(i) g(z) has simple zeros (i.e., Z(z)z"~+ has simple poles) (see Figure 6.4). 
In this case the residue K; at a pole z; is given by 


K; = lim je = a40] l (6.2.9) 


(ii) g(z) has multiple zeros (i.e., Z(z)z”~' has multiple poles). If g(z) has 
a multiple zero z; of order r, then the residue K; at z; is given by 


Ha), 


r—1 
K; = | lim a E zi) 


(r — 1)! 242; dz"71 


‘Requires some knowledge of residues in complex analysis [20]. 
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Imz 


> Rez 


FIGURE 6.4. Poles of &(z). 


Example 6.10. Obtain the inverse Z-transform of 


z(z— 1) 


AAS 
Solution Notice that 
= n-1 _ (z = 1)2” 
Beye = aaa By 
Thus Z(z)z”~! has a simple pole at z1 = —3 and a double pole at z2 = 2. 
Thus from formula (6.2.8), we get z(n) = Kı + K2, where K,, Kə are the 


n-1 


residues of x(z)z at 21, Z2, respectively. Now, 


a (z2+3)(z—-1)z"]__ —4 a 
Kı = Jim, | (z— 2)2(z +3) | = ag | 3)”, 
O . d [(z—2)2(z-1)2” 
m= | (z— 2)2(z +3) | 
= tim 2 e +32 + nz — n) -alz —1)] 
z—>2 (z+ 3) 
(8+5n) oani 
Thus 
a(n) = 5e(-ay" + FEM ayer, n= 01,2)... 


Example 6.11. Electric Circuits or a Ladder Network 


Consider the electric network shown in Figure 6.5. Here i(n) is the current 
in the nth loop; R is the resistance, which is assumed to be constant in 
every loop; and V is the voltage. By Ohm’s law, the voltage (or electric 
potential) between the ends of a resistor R may be expressed as V = iR. 
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R R 


FIGURE 6.5. A ladder network. 


Now, Kirchhoff’s? second law states that “in a closed circuit the impressed 
voltage is equal to the sum of the voltage drops in the rest of the circuit.” 
By applying Kirchhoff’s law to the loop corresponding to i(n+1) we obtain 


Rli(n + 1) — i(n + 2)] + Rli(n + 1) — i(n)] + Ri(n + 2) =0, 


or 


i(n + 2) — 3i(n +1) + i(n) =0. (6.2.10) 
For the first loop on the left we have 
V = Ri(0) + R(i(0) — i(1)), 
or 
i(1) = 2i(0) — = (6.2.11) 


Taking the Z-transform of (6.2.10) with the data (6.2.11) yields the 
equation 


lzi(0) -34(0) +] _ [2 - (1+ em) 


z2—3z4+1 7 z2—3z4+1 


(z) = 


i(0). (6.2.12) 


Let w > 0 be such that coshw = 3. Then sinhw = v5 Then expression 
(6.2.12) becomes 


z? — zcoshw 
— me 


O. zsinhw 
2 = z? —2zcoshw +1 


?Gustav Kirchhoff, a German physicist (1824-1887), is famous for his 
contributions to electricity and spectroscopy. 
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Taking the inverse Z-transform (Table 6.1, at the end of this chapter), we 
obtain 


OC ee (2 | z) (=) 1an. 


Exercises 6.2 
1. Use the partial fractions method to find the inverse Z-transform of: 


z 


G) Cen 
z(z+1) 
(b) PET: 
2. Use the power series method to find the inverse Z-transform of: 
2—2 
(a) te: 
(b) gi 
3. Use the inversion integral method to find the inverse Z-transform of: 


(0) a 


z(z+2) 
(b) (2-4) +i) (2—4) 


4. Use the partial fractions method and the inversion integral method to 
find the inverse Z-transform of: 


(a) Sy. 


z?+z+1 
(b) eien: 
In Problems 5 through 7, use the Z-transform method to solve the given 
difference equation. 


5. (The Fibonacci Sequence). x(n +2) = z(n + 1) + a(n), æ(0) = 
0, æ(1)=1. 


6. x(n +2) — 3a(n + 1) + 2z(n) = do(n), x(0) = z(1) = 0. 
7. (n+1)e(n4+1)—na(n)=n+4+1, 2x(0) =0. 


8. Consider the continued fraction 


K=K(#)=24; a 

n 0 1+ a 
_ %0 &@ a2 
bot bit bo+ 7" 


Qi _a2 an 


Let a; = b; = 1 for alli € Z*, and a(n) = pe ee... 


~ 
3 
+ 


(a) Show that a(n+1)=1+ POR Find x(n). 
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(b) Find K = 1 + limp. x(n). 

9. Prove that the convolution product is commutative and associative 
(ie, oxy = yx g;x x (yx f) =(xxy)*f). 

10. Solve, using convolution, the equation a(n+1) = 2+4 Xr _o(n—r)e(r). 


11. Solve the equation x(n) = 1 — 7" 4 e" “1 a(r). 


6.3 Volterra Difference Equations of Convolution 
Type: The Scalar Case’ 


Volterra difference equations of convolution type are of the form 
a(n +1) = Aa(n) + X` B(n — j)2(J), (6.3.1) 
j=0 


where A € R and B : Zt — R is a discrete function. This equa- 
tion may be considered as the discrete analogue of the famous Volterra 
integrodifferential equation 


x'(t) = Aa(t) +f B(t — s)x(s) ds. (6.3.2) 


Equation (6.3.2) has been widely used as a mathematical model in popu- 
lation dynamics. Both (6.3.1) and (6.3.2) represent systems in which the 
future state z(n+1) does not depend only on the present state x(n) but also 
on all past states x(n — 1), x(n — 2), .. .,£(0). These systems are sometimes 
called hereditary. Given the initial condition x(0) = xo, one can easily gen- 
erate the solution x(n, xo) of (6.3.1). If y(n) is any other solution of (6.3.1) 
with y(0) = ao, then it is easy to show that y(n) = x(n) for all n € Zt 
(Exercises 6.3, Problem 8). 
One of the most effective methods of dealing with (6.3.1) is the 

Z-transform method. Let us rewrite (6.3.1) in the convolution form 

z(n +1) = Ar(n)+ Bea. (6.3.3) 
Taking formally the Z-transform of both sides of (6.3.3), we get 

z&(z) — zz(0) = A(z) + B(z)č(2), 

which gives 

[2 - A- B(2)jë(e) = 20(0), 
or 


&(z) = zx(0)/[z — A— B(z)]. (6.3.4) 


3This section requires some rudiments of complex analysis [20]. 
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Let 
g(z) =z—-A-B(z). (6.3.5) 


The complex function g(z) will play an important role in the stability 
analysis of (6.3.1). Before embarking on our investigation of g(z) we need 
to present a few definitions and preliminary results. 


Definition 6.12. Let E be the space of all infinite sequences of com- 
plex numbers (or real numbers) x = (x(0), 2(1),#(2),...). There are three 
commonly used norms that may be defined on subsets of Æ. These are 


(i) the lı norm: |||, = wan Jæ(i)|; 


(ii) the l2, or, Euclidean norm: ||zl]2 = [E2 |x) 2]; 


(iii) the læ norm: ||z||oo = sup;>o |æ(i)]. 


The corresponding normed spaces are called l1, l2, and læ, respectively. 
One may show easily that (Exercises 6.3, Problem 6) 


1, Cle C ly. 


Definition 6.13. A complex function g(z) is said to be analytic in a region 
in the complex plane if it is differentiable there. The next result establishes 
an important property of lı sequences. 


Theorem 6.14. If x(n) €l, then: 
(i) (z) is an analytic function for |z| > 1; 
(ii) [@(z)| > [lal for |z| 2 1. 


PROOF. 


(i) Since x(n) € l1, the radius of convergence of &(z) = Jyo a(n)z~" is 


R = 1. Hence #(z) can be differentiated term by term in its region of 
convergence |z| > 1. Thus (z) is analytic on |z| > 1. Furthermore, 
since x(n) € 11, (z) is analytic for |z| = 1. 


(ii) This is left as Exercises 6.3, Problem 9. 


We now turn our attention to the function g(z) = z— A—B(z) in formula 
(6.3.5). This function plays the role of the characteristic polynomial of 
linear difference equations. (See Chapter 2.) In contrast to polynomials, 
the function g(z) may have infinitely many zeros in the complex plane. 
The following lemma sheds some light on the location of the zeros of g(z). 


Lemma 6.15 [39]. The zeros of 
gz) =z- A- Ble) 


all lie in the region |z| < c, for some real positive constant c. Moreover, 
g(z) has finitely many zeros z with |z| > 1. 
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PROOF. Suppose that all the zeros of g(z) do not lie in any region |z| < c 
for any positive real number c. Then there exists a sequence {z;} of zeros 
of g(z) with |z;| > co as i > oo. Now, 


lz- Al = [Bl < Y Billal”. (6.3.6) 


Notice that the right-hand side of inequality (6.3.6) goes to B(0) as i > 
co, while the left-hand side goes to co as i + oo, which is a contradiction. 
This proves the first part of the lemma. 


To prove the second part of the lemma, we first observe from the first 
part of the lemma that all zeros z of g(z) with |z| > 1 lie in the annulus 
1 < |z| < c for some real number c. From Theorem 6.14 we may conclude 
that g(z) is analytic in this annulus (1 < |z| < c). Therefore, g(z) has only 
finitely many zeros in the region |z| > 1 [39]. 

Next we embark on a program that will reveal the qualitative behavior 
of solutions of (6.3.1). In this program we utilize (6.3.4), which may be 
written as 


&(z) = 2(0)zg~*(z). (6.3.7) 


Let y be a circle that includes all the zeros of g(z). The circle y is guaranteed 
to exist by virtue of Lemma 6.15. By formula (6.2.7) we obtain 


rure TEOLO de, (6.3.8) 


and by formula (6.2.8) we get 
x(n) = sum of residues of [a(0)z"g~*(z)]. (6.3.9) 


This suggests that 


a(n) = X` pr(n)z?, (6.3.10) 


where the sum is taken over all the zeros of g(z) and where p,(n) is a 
polynomial in n of degree less than k — 1 if zy is a multiple root of order k. 
To show the validity of formula (6.3.10), let z, be a zero of g(z) of order k. 
We write the following Laurent’s series expansion [20]: 


Co 


Cae = 5 gn(Z — zr)”, for some constants gn, 


n=—k 
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The residue of x(0)z"g~' at zr is x(0) times the coefficient of (z — z,)~! in 
g_\(z)z”. The coefficient of (z — z,)~! in g~!(z)z” is given by 


n n—k+1 n n—k+2 ow n n 6 3 11 
IJ-k l = :) Zr +9-k+1 k = ) Zr + +9-1 G Žr: ( ove ) 


It follows from formula (6.3.9) that x(n) may be given by formula (6.3.10). 
Formula (6.3.10) has the following important consequences. 


Theorem 6.16 [39]. The zero solution of (6.3.1) is uniformly stable if 
and only if: 


(a) z— A — B(2) £0 for all |z| > 1, and 


(b) if zr is a zero of g(z) with |zr| = 1, then the residue of z"g~\(z) at zr 
is bounded as n — oo. 


PROOF. Suppose that conditions (a) and (b) hold. If z, is a zero of g(z) 
with |z,| < 1, then from formula (6.3.10) its contribution to the solution 
x(n) is bounded. On the other hand, if z, is a zero of g(z) with |z,| = 1 at 
which the residue of x(0)z"g~1(z) is bounded as n — 00, then from formula 
(6.3.9) its contribution to the solution x(n) is also bounded. This shows that 
|x(n)| < L|x(0)| for some L > 0, and thus we have uniform stability. The 
converse is left to the reader as Exercises 6.3, Problem 10. 


We observe here that a necessary and sufficient condition for condition 
(b) is that each zero z of g(z) with |z| = 1 must be simple (Exercises 6.3, 
Problem 11). 

The next result addresses the question of asymptotic stability. 


Theorem 6.17 [39]. The zero solution of (6.3.1) is uniformly asymptot- 
ically stable if and only if 


z—-A-—B(z) 40, for all |z| >1. (6.3.12) 


PROOF. The proof follows easily from formula (6.3.10) and is left to the 
reader as Exercises 6.3, Problem 12. 


Exercises 6.3 


1. Solve the Volterra difference equation x(n+1) = 2a(n)+57"_,2"-"a(r), 
and then determine the stability of its zero solution. 


2. Solve the Volterra difference equation a(n + 1) = —$2(n) + 
Xo 8"~” a(r), and then determine the stability of its zero solution. 


3. Use Theorems 6.16 and 6.17 to determine the stability of the zero 
solutions of the difference equations in Problems 1 and 2. 


*10. 


11. 


*12. 
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. Without finding the solution of the equation 


n(n +1) =—52(n) 4 S G) o, 


r=0 


determine the stability of its zero solution. 


. Determine the stability of the zero solution of a(n + 1) = 2a(n) — 


12>" _9(n — r)a(r), using Theorem 6.16 or 6.17. 


. Prove that ly Cc Ip E bes 


. Let x = {£n} and y = {yn} be two lı sequences. Prove that x * y € lı 


by following these steps: 


(i) If Deep elt) = a, Do ylt) = b, and e(n) = X a(n — 
i)y(i), show that S77, c(i) = ab. 


(ii) Prove that 2%ole(n)| < (No ON (EZ WOI) - 


. Prove the uniqueness of solutions of (6.3.1), that is, if x(n) and y(n) 


are solutions of (6.3.1) with «(0) = y(0), then x(n) = y(n) for all 
neZr. 


. If x(n) € l show that |%(z)| < ||z||1 for |z| > 1. 


Suppose that the zero solution of (6.3.1) is uniformly stable. Prove 
that: 


(a) g(z) = z — A — B(z) £0 for all |z| > 1. 


(b) If zr is a zero of g(z) with |z,| = 1, then the residue of z”g~1(z) 
at z, is bounded. 


Prove that a necessary and sufficient condition for condition (b) in 
Theorem 6.16 is that z, be a simple root of g(z). 


Prove Theorem 6.17. 


6.4 Explicit Criteria for Stability 


of Volterra Equations 


The stability results in Section 6.3 are not very practical, since locating the 
zeros of g(z) is more or less impossible in most problems. In this section 
we provide explicit conditions for the stability of (6.3.1). The main tools 
in this study are Theorems 6.17 and Rouché’s Theorem (Theorem 5.13). 
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Theorem 6.18 [39]. Suppose that B(n) does not change sign for n € Z+. 
Then the zero solution of (6.3.1) is asymptotically stable if 


5 B(n) 
n=0 


PROOF. Let 8 = >o B(n) and D(n) = 6-*B(n). Then Xpo D(n) = 
1. Furthermore, D(1) = 1 and |D(z)| < 1 for all |z| > 1. Let us write g(z) 
in the form 


|A| + <1. (6.4.1) 


glz) = z — A — BĎ(2). (6.4.2) 


To prove uniform asymptotic stability of the zero solution of (6.3.1), it 
suffices to show that g(z) has no zero z with |z| > 1. So assume that 
there exists a zero zp of g(z) with |z,| > 1. Then by (6.4.2) we obtain 
Izr — A| = |BD(z)| < |8|. Using condition (6.4.1) one concludes that |z,| < 
|A| + |B] < 1, which is a contradiction. This concludes the proof of the 
theorem. 


Unfortunately, we are not able to show that condition (6.4.1) is a neces- 
sary condition for asymptotic stability. However, in the next result we give 
a partial converse to the above theorems. 


Theorem 6.19 [39]. Suppose that B(n) does not change sign forn € Z”. 
Then the zero solution of (6.3.1) is not asymptotically stable if any one of 
the following conditions holds: 

(i) A+ 35°, B(n) > 1. 


n=0 


(ii) A+ Lo B(n) < —1 and B(n) > 0 for some n € Zt. 


n=0 


(iii) A+} o B(n) < —1 and B(n) < 0 for some n € Z*, and °° B(n) 
is sufficiently small. 


PROOF. Let 8 and D(n) be as defined in the proof of Theorem 6.18. 


(i) Assume condition (i). If A+ 6 = 1, then clearly z = 1 is a root of g(z) 
defined in (6.4.2). Hence by Theorem 5.17 the zero solution of (6.3.1) 
is not asymptotically stable. If A+ 8 > 1, say A+ 6 = 1 + ô, then 
there are two areas to consider. 


(a) If 6 < 0, then we let y be the circle in the complex plane with 
center at A and radius equal to |8| + 46. Then on y (Figure 6.6) 
we have |z| > 1 and thus 


|@D(z)| < |8| < |z- Al. (6.4.3) 


Let h(z) = —GD(z), f(z) = z — A. Then from inequality (6.4.3) 
|h(z)| < | f(z)| on y. Hence by Rouché’s Theorem (Theorem 5.13), 
g(z) = f(z) +h(z) and f(z) have the same number of zeros inside 
y. Since A is the only zero of f(z) inside y, then g(z) has exactly 
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FIGURE 6.6. A circle with center A and radius |@| + $. 


one zero zo inside y with |z9| > 1. Again by using Theorem 6.16, 
the zero solution of (6.3.1) is not asymptotically stable. 


Suppose that 8 > 0. Since A+ 8 > 1, it follows that g(z) = 
1— A- < 0. Moreover, |D(A + @)| < 1. Thus g(A + 8) = 
Bil — D(A + 8)| > 0. Therefore, g(z) has a zero between 1 and 
A + 8 and, consequently, by Theorem 6.17, the zero solution of 
(6.3.1) is not asymptotically stable. This completes the proof of 
condition (i). 


=> 
ion 
= 


Parts (ii) and (iii) are left to the reader as Exercises 6.4, Problems 7 
and 8. 


The above techniques are not expendable to uniform stability. This is 
mainly due to the lack of easily verifiable criteria for condition (b) of The- 
orem 6.16. Therefore, new techniques are needed to tackle the problem of 
uniform stability. These techniques involve the use of Liapunov functionals 
(functions), which we have encountered in Chapter 4. 

Let E by the space of all infinite sequences of complex numbers as 
defined in Definition 6.12. Then a function V : EF — R is said to 
a Liapunov functional if, for x = {x(n)} € E, 


(i) V(x) is positive definite (Chapter 4), 
(ii) AV(a) < 0, 


where AV (x) = V(#) — V(x) and &(n) = x(n +1) for all n € Z+. 
The next result illustrates the use of Liapunov functionals in stability 
theory. 


Theorem 6.20 [39]. The zero solution of (6.3.1) is uniformly stable if 


[A+ YC |B)| <1 for all ne Zt. (6.4.4) 
j=0 
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ProoFr. For z« € E, let 


n—1 œ 


V(x) = |a(n)|+ XC X B(s- rje). (6.4.5) 


r=0 s=n 
Then 


n 


AV (a) = |Aa(n) + X` B(n — j)x(j jaye or B(s —r)||a(r)| 


j=0 r=0 s=n4+1 
aey y Beben (6.4.6) 
r=0 s=n 
< A+ S180) i iei (6.4.7) 


By assumption (6.4.4) we thus have 
AV (£) <0. (6.4.8) 


From (6.4.5) we obtain |a(n)| < V(x). Using inequality (6.4.8) and 
expression (6.4.5) again we obtain 


lz(n)| < V(x) < [æ(0). 


Consequently, the zero solution is uniformly stable (Chapter 4). 


Exercises 6.4 


Use Theorem 6.19 to determine the stability and instability of the zero 
solution of the equations in Problems 1, 2, and 3. 


1. s(a +1) = —4a(n) + Ero (5) elr). 

2. r(n+1)= ee + ro (n— r)a(r). 

3. a(n +1) = ġz(n) + pe” *a(r). 

4. Find the values of a for which the zero solution of the equation x(n) = 
Suma, —r—1)a""-1!2(r) is: 


(i) uniformly stable, 


(ii) asymptotically stable, 
(iii) not asymptotically stable. 


5. Determine the values of a for which the zero solution of the equation 
Aa(n) = —32(n) + 0P_)(n—r)?a"~"x(r) is asymptotically stable. 


6. Prove Theorem 6.18 using the method of Liapunov functionals used in 
the proof of Theorem 6.20. 
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7. Prove part (ii) of Theorem 6.19. 
8. Prove part (iii) of Theorem 6.19. 


9. Provide details of how inequality (6.4.7) is obtained from inequality 
(6.4.6). 


10. (Open problem). Discuss the stability of the zero solution of (3.5.1) 
under the condition A + °°) B(n) = —1 and O°.) B(n) < 0. 


11. (Open problem). Can we omit the assumption that Xpo B(n) is 
sufficiently small in Theorem 6.19, part (iii)? 


12. (Open problem). Develop a necessary and sufficient condition for the 
asymptotic stability of the zero solution of (6.3.1). 


6.5 Volterra Systems 


In this section we are mainly interested in the following Volterra system of 
convolution type: 


a(n +1) = Aa(n) + X` B(n— j)2(J), (6.5.1) 
j=0 


where A = (a;;) is a k x k real matrix and B(n) is a k x k real matrix 
defined on Z*. It is always assumed that B(n) € l, i.e., 972 |[B(J)| < œ. 
The Z-transform for sequences in R? and matrices R*** is defined in the 
natural way, that is, 


Zlx(n)] = (Z(ar(n)), Z(w2(n)),..-,Z(aeln))) 
Z|B(n)| = (Z(bi;(n)). 


Thus all the rules and formulas for the Z-transform of scalar sequences 
hold for vector sequences and matrices. 
Taking the Z-transform of both sides of (6.5.1), one obtains 


2%(z) — zx(0) = A&(z) + B(z)#(z), |z| >R, 
which yields 
(z) = [zI — A— B(z)]"1z2(0), |z| >R. (6.5.2) 


Theorem 6.17 for scalar equations has the following counterpart for 
systems. 


Theorem 6.21. A necessary and sufficient condition for uniform 
asymptotic stability is 


det(zI — A— B(z)) #0, foral |z| > 1. (6.5.3) 


300 6. The Z-Transform Method and Volterra Difference Equations 


PROOF. See [39]. 


An application of the preceding theorem will be introduced next. This 
will provide explicit criteria for asymptotic stability. But before introducing 
our result we need the following lemma concerning eigenvalues of matrices. 


Lemma 6.22 [14]. LetG = (gij) be a kxk matriz. If z is an eigenvalue 
of G, then: 


(i) |20 — gullzo — 9431 < X; girl Oy lgzrl; for some i,j,i 4 j, and 
(ii) |zo rat Gut||Zo z gss| < y \gre| ee \drs|; for some t, s,t a S, 
where X`’, gir means ar Jir) — Jü. 


Using the above lemma we can prove the next result. Let 


Theorem 6.23 [39]. The zero solution of (6.5.1) is uniformly asymptot- 
ically stable if either one of the following conditions holds: 


(i) Xi (laiz| + Bij) < 1, for each i,1 <i < k, or 


Gi) OE (asj| + Biz) <1, for each j,1 < j < k. 


PRrooF. (i) To prove uniform asymptotic stability under condition (i) we 
need to show that condition (6.5.3) holds. So assume the contrary, that is, 


det(zpI — A— B(z)) =0 for some zo with |zo| > 1. 


Then zo is an eigenvalue of the matrix A + B(zo). Hence by condition (i) 
in Lemma 6.22, we have 


f $ 
[zo — aii — bi (20) ||20 — ajj — bjj (Z0)] < 5y [dir + bir (Z0)| X lajr + bjr(20)]. 


(6.5.4) 
But 


1 
> X (airl + |Gir)| (by condition (i)). 


Similarly, 


/ 
zo — ajj — by3(20)| > X- (lajr| + Bir). 
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Combining both inequalities, we get 


1 


|20 — ai — bi(zo)l|zo — ajj — bjj(20)| > X (lair| + Bir) X (larl + Bjr). 


Tr 


It is clear that this contradicts inequality (6.5.4) if one notes that for any 
1<s,m< k, 


|ase| + Bst > |ase| + \bse(Z0)| = Jast + bst(Zo)|- 


As in the scalar case, the above method may be extended to provide 
criteria for uniform stability. Again, the method of Liapunov functionals 
will come to the rescue. 


Theorem 6.24 [39]. The zero solution of (6.5.1) is uniformly stable if 


k 


5 laij] + biz <1 (6.5.5) 


i=1 


for all j =1,2,...,k. 
ProoF. Define the Liapunov functional 


k n-1 œ 


k 
D Jz(r) + SO > byts- lle) 


i=1 j=1 r=0 s=n 
Then 


k 
dE laiglles(n)| — læ:(n)] 


i=1 bj 


k oo 
+E D byl- wle]: (6.5.6) 


j=1 s=n 


D 
= 

Ds 

= 
IA 
Me 


A crucial but simple step is now in order. Observe that 


and 


2 2, A laeo (2 ec wie 


i=1 j=1 s i=1 j=l s=n 


(Exercises 6.5, Problem 1). 
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Hence inequality (6.5.6) now becomes 


k 


AVo.5.1)(£ <> DE |zi(n)| 


t=1 | 7=1 
<0 (by condition (6.5.5)). 
This implies that 


k 
een) < VG) < X lel = eO, 


which proves uniform stability. 


Example 6.25. An Epidemic Model [89] 


Let x(n) denote the fraction of susceptible individuals in a certain popula- 
tion during the nth day of an epidemic, and let a(k) > 0 be the measure 
of how infectious the infected individuals are during the kth day. Then the 
spread of an epidemic may be modeled by the equation 


1 n 
In ———~ = 1 = — j ] 6.5.7 
apyg T Ll + e- eln- pal) (6.5.7) 
where € is a small positive number, n € ZT. 
To transform (6.5.7) into a Volterra-type equation, we put x(n) = e4”), 
Then we obtain 


y(n +1) = aln- j) + e- #0). (6.5.8) 
j=0 


Since x(n) € [0,1], we have y(n) > 0 for all solutions of (6.5.8). Observe 
that during the early stages of the epidemic x(n) is close to 1 and, con- 
sequently y(n) is close to zero. Hence it is reasonable to linearize (6.5.8) 
around zero. So if we replace é¥%) by 1 — y(j), (6.5.8) becomes 


y(n +1) oe jle +y), y(0) =0. (6.5.9) 


Taking the Z-transform of both sides of the equation yields 
z > EZ % x 
(2) = a2) + a(2) 512), 


Ss Ez A(z) 

1) = Gre a) 
If a(n) has a simple form, one may be able to compute y(n). For example, 
if a(n) = ca”, then a4 = 


(6.5.10) 


EC Z EC 1 a+c 


o: a—c |z-1 z-a-c 
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Thus 
EC 
= ——_|1 - R 6.5.11 
un) = ee lh (a+ 0" (6.5.11) 
Now if0<a+c<1, then lim y(n) = =a and hence the spread 
n—00 1— (a+c) 


of the disease will not reach epidemic proportions. 

Let us now turn our attention to the nonlinear equation (6.5.8). Let §(n) 
be the solution of (6.5.8) with (0) = 0. Then the global stability of §(0) 
is established by the following result (Kocic and Ladas [80]). 


Theorem 6.26. Assume that 


X. a(n) < 1. 
n=0 


Then §(n) is a globally asymptotically stable solution of (6.5.8). 


PROOF. We first make the change of variable u(n) = y(n)—G(n) in (6.5.8). 
Then we have 


u(n + 1) = Soa (n= je (1 — er), (6.5.12) 
j=0 


By induction on n, one may show that u(n) = y(n) — g(n) > 0. 
Consider the Liapunov function 


Then 


AV(n, u(n)) = V(n+ 1, u(n+ 1)) — V(n, u(n)) 


n 


= (1-a)! bs a(n — je =l g0) 


j=0 


+y 5a (s—r) (0 


r=0 s+n+1 


-0 -afu HE Sa a(s — r)ulr)| 
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j=0 r=0 s=n+1 
+ X a(s—n)u(n) — 9(n) 
s=n+1 
— 5 5 a(s — r)u(r) — 5 a(n — ju(n| 
r=0 s=n+1 r=0 
<(1-a) (Zaen) — 1 Jul) 


< (1—a)7*(a—1)u(n) < —u(n). 


Hence by Theorem 4.20,* the zero solution of (6.5.8) is globally asymptot- 
ically stable. 


Exercises 6.5 


1. Prove that 


k lee) k k oc 
BaP bat -Dle EE X lal -nle 


In Problems 2 through 6 determine whether the zero solution of the given 
equation is uniformly stable or uniformly asymptotically stable. 


2. a(n +1) = Z? o B(n— j)z(j), where B(n) = k a 


1 
0 Ż 
3. a(n + 1) = Agz(n) + $j- B(n — j)z(j), where A = 1 7 , 
3 4 
AOp i 
B(n) = ( 0 aa) 
5 , , —1 477-1 
4. æ(n +1) = $2; B(n — j)e(j), where B(n) = ( ý a 
5. a(n +1) = Z? o B(n— j)a(j), where B(n) = Ps os) 


“Observe that Theorem 4.20 is valid also for nonautonomous equations as well 
as Volterra difference equations. The proof is a slight modification of the proof 
in the text. 
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*6. Theorem ((14]). Let G = (gij) be a real k x k matrix. Then det G > 0 


if gu > 0, GuGjj > » CADDA |g;r], forall 1 <i j <k i Fj. 
Assume that vij = X o bij(n) < 00 for 1 < i, j < k. Suppose that 
the following two conditions hold: 


(i) Qi tvi >l, 1<i<k. 


(ii) (aig +Vii— 1) (055 +15; —-1) = E lair +Vix| forl<i, j<k,i Æ j. 
Prove that: 


(a) If k is odd, then the zero solution of (6.5.1) is not 
asymptotically stable. 


(b) If k is even, then the zero solution of (6.5.1) may or may not 
be asymptotically stable. 


*7, (Open problem). Discuss the stability of the zero solution of (6.5.1) 
under the condition aji; + Vi <1, 1 < i < k. Consider the Volterra 
system with infinite delay 


a(n+1)= n+ DB (n= j)z (6.5.14) 


8. Mimic the proof of Theorem 6.23 to find criteria for the asymptotic 
stability of the zero solution of (6.5.7). 


9. Mimic the proof of Theorem 6.24 to find criteria for the uniform 
stability of the zero solution of (6.5.7). 


10. Prove Theorem 6.23 using the method of Liapunov functionals (as in 
Theorem 6.24). 


6.6 A Variation of Constants Formula 


Associated with the homogeneous system (6.5.1) we contemplate the 
following nonhomogeneous system: 


y(n+1)= in) + Bn al i) + g(n), (6.6.1) 


where g(n) € R*. 

The existence and uniqueness of solutions of system (6.5.1) may be es- 
tablished by a straightforward argument (Exercises 6.6, Problem 13). Let 
ei = (0,...,1,...,0)7 be the standard ith unit vector in R¥, 1 < i < k. 
Then there are k vector solutions x1(n), x2(n), x3(n),...,£p(n) of system 
(6.5.1) with x;(n) = e;,1 < i < k. The solutions are linearly independent 
on Z*. For if there is a nontrivial linear relation cyx1(n) + coxo(n) +--+ 
Cre, (n) = 0 on Z*, then at n = 0 we have cye, + C2€2 + +++ + Ckek = 0. 
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This proves that cı C2 a Ck 0, which is a contradiction. The 
k x k matrix X(n) whose ith column is z;(n), is called the fundamental 
matrix of system (6.5.1). Notice that X(n) is a nonsingular matrix with 
X(0) = I. Moreover, x(n) = X(n)zo is a solution of system equations 
(6.5.1) with x(0) = zo (Exercises 6.6, Problem 1). Furthermore, the funda- 
mental matrix X(n) satisfies the matrix equation (Exercises 6.6, Problem 
2) 


X(n+1) = AX(n) + Bin- j)X (9). (6.6.2) 
j=0 


It should be pointed out that the fundamental matrix X(n) enjoys all 
the properties possessed by its counterpart in ordinary difference equations 
(Chapter 3). 

Next we give the variation of constants formula. 


Theorem 6.27. Suppose that the Z-transforms of B(n) and g(n) exist. 
Then the solution y(n) of system (6.6.1) with y(ng) = yo is given by 


n—-1 


y(n, 0, yo) = X(n)yo + 5 X(n—r—1)g(r). (6.6.3) 
r=0 


PROOF. We first observe that (Why?) 


X(n+1) = AX(n)+ 3 B(n—r)X(r). (6.6.4) 
r=0 


Taking the Z-transform of both sides of (6.6.4), we obtain, for some R > 0, 
2X(z) — zX (0) = AX(z) + B(z)X(z), |z|>R. 
This yields 
zI- A- BX (A= zI, |z|>R. (6.6.5) 


Since the right-hand side of (6.6.5) is nonsingular, it follows that the matrix 
zI — A — B(z) is also nonsingular. (Why?) This implies that 


X(z) = 2[zI — A- Bz), z| >R. (6.6.6) 


In the next step of the proof we take the Z-transform of both sides of 
system (6.6.1) to obtain 


G(2) = kI - A- Bi2)| [eyo + G(2)], |z| > Ra, 


for some R, > R, and by using formula (6.6.6) this gives 


H(z) =X) + (I), lel > Ra. 
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Thus 
uln) = 21K ewe] + 27 [5 Kale) 
= X(n) + $` X(n -r — 1)g(r) 
r=0 


(using formulas (6.1.4) and (6.1.8)). 


Exercises 6.6 


1. Let X(n) be the fundamental matrix of system equation (6.5.1). Prove 
that s(n) = X(n)zo is a solution of (6.5.1) for any vector xo € R*. 


2. Prove that the fundamental matrix X(n) satisfies (6.6.2). 


3. Prove that the zero solution of (6.5.1) is uniformly stable if and only 
if |a(n, no, xo)| < M|xo| for some M > 0. 


4. Prove that the zero solution of (6.5.1) is uniformly asymptotically sta- 
ble if and only if there exist M > 0, v € (0,1) such that |x(n, no, £o)| < 
Mv", 


5. Solve the equation 
n(n) = —2VBer(n)-+ >> 2"-7 (320 ) o(r)+42"(3"), (0) = 0: 
r=0 


(a) by the Z-transform method, 
(b) by using Theorem 6.27. 
6. Solve the equation x(n + 1) = e(n) + roln —r)a(r) +n: 
(a) by the Z-transform method, 
(b) by using Theorem 6.27. 


7. Consider the planar system x(n + 1) = Ar(n) + D9 B(n — j)a(g) + 
g(n), x(0) = 0, where 


-v2 0 2/2 Q 
A= , B(n)= zs 
0 —-Vv6 0o Sea 
a) Find the fundamental matrix X(n) of the homogeneous equation. 
(a) g q 
n 
(b) Use Theorem 6.27 to solve the equation when g(n) = (o : 


8. Consider the system Az(n) = Si, B(n — j)a(i) + g(n), where 


B(n) = ( 2 . 


308 6. The Z-Transform Method and Volterra Difference Equations 


(a) Solve the homogeneous part when g(n) = 0. 


(b) Use Theorem 6.27 to find the solution of the nonhomogeneous 


a 
equation when g(n) = e , where a is a constant. 


9. Consider the system 
y(n + 1) = Ay(n) +g(n), y(0) = yo. (6.6.7) 
Use the Z-transform to show that: 
(a) A?” = Z-[2(2I — A)-}). 
(b) Sag APT g(r) = Z-[(2E — A)-19(2)]. 


(c) Conclude that the solution of the given equation is given by y(n) = 
Z-*[2(2zI — A)~*]yo + ZHI — A)~*9(2)]. 


10. Use (6.6.5) to show that for some R > 0,det(zI — A — B(z)) £ 0 for 
|z| > R. 


Apply the method of Problem 9 to solve equation (6.6.7) in Problem 9 
if A and g(n) are given as follows: 


iinet R = 3 = 
ANS cate au i » y(0)=0. 


paaa (n)=0 
AEko og STS 


13. Prove the existence and uniqueness of the solutions of (6.6.1). 


6.7 The Z-Transform Versus 
the Laplace Transform? 


The Laplace transform plays the same role in differential equations as does 
the Z-transform in difference equations. For a continuous function f(t), the 
Laplace transform is defined by 


f(s) =L(f@) = i e“ f(t) dt. 


If we discretize this integral we get \~ )e~*"f(n). If further we let 
z = ef, we get the Z-transform of f(n), namely Xpo f(n)z~”. Hence 


>This section may be skipped by readers who are not familiar with the Laplace 
transform. 
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given s = a+ iĝ in the s-plane (commonly called the frequency domain in 
engineering), then 


y= ec tib =g ei = ges geteen) nez. 


Hence a point in the z-plane corresponds to infinitely many points in the s- 
plane. Observe that the left half of the s-plane corresponds to the interior 
of the unit disk |z| < 1 in the z-plane. Thus asymptotic stability of a 
differential equation is obtained if all the roots of its characteristic equation 
have negative real parts. In difference equations this corresponds to the 
condition that all the roots of the characteristic equation lie inside the unit 
disk. 

There is another method that enables us to carry the stability analysis 
from the s-plane to the z-plane, i.e., from differential equations to difference 
equations. Suppose that the characteristic equation of a difference equation 
is given by 


P(z) = aoz” + a12”! +--+ +a, =0. 
The bilinear transformation defined by 


s+1 
s—l 


maps the interior of the unit disk to the left half-plane in the complex plane 
(Figure 6.7). To show this we let s = a+ i@. Then 


atib+ 1 
at+iB-1 


Imz A 


` 
N 
x 
S 
S 
N 


ANN 


aN 


Res 


NANASN APS SN SS 


z-plane 


FIGURE 6.7. A bilinear transformation. 
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or 
(a +1)? +6 


(a1 + S 


which gives a < 0. 


Now substituting z = $+ 


s—1 
n n—1 
s+1 s+1 
ao + Ay +---+a, =0, 
s—1 s—1 


Q(s) = bos” + bis”! +--+ bn =0. 


We now can apply the Routh stability criterion [102] to Q(s) to check 
whether all the zeros of Q(s) are in the left half-plane. If this is the case, 
then we know for sure that the zeros of P(z) all lie inside the unit disk. We 
are not going to pursue this approach here, since the computation involved 
is horrendous. 


into P(z) we obtain 


or 
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TABLE 6.1. Z-transform pairs. 
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x(n) for n = 0,1,2,3,... : As = 
R oe ee oe #2) = Din, aN 
1. 1 z/z—1 
2. a” z/z—a 
3. a 1 
4. n z/(z—1)° 
5. n? z(z+1)/(z -1% 
6. n? 2(z7 +424 1)/(z—1)? 
7. nk CDD (4;);D=22 
8. na” az/(z—a)* 
9. na” az(z +a)/(z — a) 
10. n’a” az(z* + 4az + a*)/(z—a)* 
11. na” (—1)*D* (5) ;D=z 4 
12. sin nw z sin w/ 
(z2? — 2z cos w +1) 

13. cos nw z(z— cos w)/ 

(2? —2z cos w + 1) 
14. a” sin nw az sin nw/ 

(z2? —2az cos w + a?) 
15. a” cos nw z(z—a cos w)/ 

(z2? —2az cos w + a’) 
16. doln) I 
17. ôm (N) ZFR: 
18. a”/n! are 
19. cosh nw z(z— cosh w)/ 

(2? —2z cosh w + 1) 
20. sinh nw z sinh w/ 

(z? — 2z cosh w + 1) 
21. z,n>0 In (z/z—1) 
22: e “" a(n) & (ez) 
23. n® = n(n —1) 2z/(z —1)8 
24. n® = n(n — 1)(n — 2) 3!z/(z — 1) 
25. n™ =n(n—1)---(n—k4+1) klz/(z—1)**3 
26. x(n — k) z "&(z) 
27. a(n +k) 2(z) — eA a(r) 


7 
Oscillation Theory 


In previous chapters we were mainly interested in the asymptotic behav- 
ior of solutions of difference equations both scalar and nonscalar. In this 
chapter we will go beyond the question of stability and asymptoticity. Of 
particular interest is to know whether a solution x(n) oscillates around an 
equilibrium point 2*, regardless of its asymptotic behavior. Since we may 
assume without loss of generality that «* = 0, the question that we will 
address here is whether solutions oscillate around zero or whether solutions 
are eventually positive or eventually negative. 

Sections 7.1 and 7.3 follow closely the paper of Erbe and Zhang [53] and 
the book of Gyori and Ladas [63]. In Section 7.2 we follow the approach 
in the paper of Hooker and Patula [67]. For more advanced treatment of 
oscillation theory the reader is referred to [3], [63], [64], [79]. 


7.1 Three-Term Difference Equations 


In this section we consider the three-term difference equation (of order 
k+1) 

a(n+1)—2(n)+p(n)z(n—k)=0, nezZ*, (7.1.1) 
where k is a positive integer and p(n) is a sequence defined for n € Z+. 

A nontrivial solution x(n) is said to be oscillatory (around zero) if for 
every positive integer N there exists n > N such that x(n)a(n+1) < 
0. Otherwise, the solution is said to be nonoscillatory. In other words, a 
solution x(n) is oscillatory if it is neither eventually positive nor eventually 
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negative. The solution x(n) is said to be oscillatory around an equilibrium 
point «* if x(n) — x* is oscillatory around zero. The special case, where 
k = 1 and p(n) = p is a constant real number, has been treated previously 
in Section 2.5. In this case (7.1.1) may be written in the more convenient 
form 


x(n + 2)-— x(n +1) + pz(n) = 0. (7.1.2) 
The characteristic roots of (7.1.2) are given by 
1 1 
A2 == 1 — Ap. 
12533 


Recall from Section 2.5 that all solutions of (7.1.2) oscillate if and only if 
Ai and àz are not positive real numbers. Hence every solution of (7.1.2) 
oscillates if and only if p > L, 

Let us now turn our attention back to (7.1.1). This equation is the 
discrete analogue of the delay differential equation 


x'(t) + p(t)x(t — k) = 0. (7.1.3) 


The oscillatory behavior of (7.1.3) is remarkably similar to that of its dis- 
crete analogue (7.1.1), with one exception, when k = 0. In this case, the 
equation 


x'(t) + p(t)a(t) = 0 


v(t) = 2o) exp(— f i v(s)ds) 


which is never oscillatory. However, the discrete analogue 
a(n +1) = (1 — p(n))x(n) 


has the solution x(n) = Kine (1 - p(j)| z(no), which oscillates if 1 — 


J=N0 
p(j) <0 for all j > no. 
To prepare for the study of the oscillatory behavior of (7.1.1) we first 
investigate the solutions of the following associated difference inequalities: 


has the solution 


x(n +1)— a(n) + p(n)a(n — k) <0, (7.1.4) 
x(n +1)— a(n) + p(n)a(n — k) > 0. (7.1.5) 


In the sequel we make use of the notions of the limit superior and the 
limit inferior of asequence {a(n)}, denoted by lim sup a(n) and lim inf a(n), 
n— o0 n—>o0 


respectively. 


Definition 7.1. Let {a(n)} be a sequence of real numbers. Let (n) be 
the least upper bound of the set {a(n),a(n+ 1), a(n + 2),...}. Then either 
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p(n) = + for every n, or the sequence {8(n)} is a monotonically decreas- 
ing sequence of real numbers, and thus lim,_,.. (n). Similarly, let a(n) be 
the greatest lower bound of the set {a(n), a(n + 1), a(n + 2),...}. Then: 


(i) limsup a(n) = limn b(n). 


n= oo 


(ii) liminf a(n) = limp% a(n). 
n— oo 


Note that lim, ... aln) exists if and only if limsupa(n) = liminf a(n) = 
n—0o n—> o0 


Jim, a(n). 


Example 7.2. Find the limit superior and the limit inferior for the 
following sequences: 


Sı :0,1,0,1,.... 


Solution 
limsup Sı = 1, liminf S2 = 0, 
n= noo 


limsup S2 = œ, liminf S2 = —o, 
n— o0 n—>o0 


limsup S3 = 1, liminf S3 = 0. 
n— o0 n—> oo 


Theorem 7.3 [53]. Suppose that 


kk 
lim inf p(n) = p > 


—____.. 7.1.6 
n— o0 (k + 1)e+1 ( ) 


Then the following statements hold: 


(i) Inequality (7.1.4) has no eventually positive solution. 
(ii) Inequality (7.1.5) has no eventually negative solution. 


ProoF. (i) To prove statement (i), assume the contrary, that is, there 
exists a solution x(n) of inequality (7.1.4) that is eventually positive. Hence 
there exists a positive integer Nı such that x(n) > 0 for all n > Mı. 
Dividing inequality (7.1.4) by a(n), we get, for n > Ni, 


a(n — k) 
a(n) — 


a(n +1) i= 


Cie (7.1.7) 
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If we let z(n) = a. then 
x(n — k) a(n—k) a(n—k+1) 
x(n) = a(n —k+1)a(n—k+2)’""’ x(n) 
= 2(n—k)z(n—k+1),...,2(n—1). 


Substituting into inequality (7.1.7) yields 


1 

a < 1-—p(n)z(n— k)z(n—=k+1)---z(n=1), n>N +k. (7.1.8) 
Now, condition (7.1.6) implies that there exists a positive integer Ng such 
that p(n) > 0 for all n > Ng. Put N = max{No, Ni + k}. Then for 
n > N,a(n+1)- a(n) < —p(n)a(n — k) < 0. Consequently, x(n) is non- 
increasing, and thus z(n) > 1. Let liminf z(n) = q. Then from inequality 

noo 

(7.1.8) we have 


1 
li 5 = — 1 
SAR z(n) liminfz(n) /4 
T00 


< 1-—liminf[p(n)z(n — k)z(n— k — 1),...,z(n — 1)], 


noo 

or 

1 

=<1- p, 

q 
which yields 

q—1 
p< ae (7.1.9) 


Let h(q) = (¢—1)/q**!. Then h(q) attains its maximum at q = (k + 1)/k. 
Hence maxg>1h(q) = (k*)/(k + 1)**+. Hence from inequality (7.1.9) we 
have p < (k*)/(k+1)**1, a contradiction. This completes the proof of part 
(i) of the theorem. The proof of part (ii) is left to the reader as Exercises 
7.1, Problem 6. 


Corollary 7.4. If condition (7.1.6) holds, then every solution of (7.1.1) 
oscillates. 


PROOF. Suppose the contrary and let x(n) be an eventually positive solu- 
tion of (7.1.1). Then inequality (7.1.4) has an eventually positive solution, 
which contradicts Theorem 7.3. On the other hand, if (7.1.1) has an eventu- 
ally negative solution, then so does inequality (7.1.5), which again violates 
Theorem 7.3. 


The above corollary is sharp, as may be evidenced by the following 
example, where we let 
kk 
p(n) = (e+ De" 
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Example 7.5. Consider the difference equation 


a(n +1) — a(n) + (k*/(k + 1)**)a(n — k) = 0. 


n-1 
Then a(n) = (5) ,n > 1, isa nonoscillatory solution of the equation. 


Next we give a partial converse of Corollary 7.4. 
Theorem 7.6 [53]. Suppose that p(n) > 0 and 
kk 
SEFI 


Then (7.1.1) has a nonoscillatory solution. 


sup p(n) (7.1.10) 


PROOF. As in the proof of Theorem 7.3, we let z(n) = «(n)/a(n+ 1) in 
(7.1.1) to obtain 
1/z(n) = 1 — p(n)z(n — k)z(n—k+1)---2(n—- 1). (7.1.11) 


To complete the proof, it suffices to show that (7.1.11) has a positive 
solution. To construct such a solution we define 


k+1 


z(l—k)=2(2-—k)=---=2z(0)=a i >1 (7.1.12) 
and 
2(1) = [1 — p(1)z(1 — k)z(2 — k)--- z(0)]?. (7.1.13) 
Then z(1) > 1 also. We claim that z(1) < a. To show this, we have 
2(1) _ 1 
a a{l—p(1)z(1—&)--- z(0)] 


S k k 
kk k+1 
(k + 1) [1 (FIEF ( X ) | 
Hence by induction, we may show that 1 < z(n) < a, with n = 1, 2, 3,.... 
Moreover, z(n) is a solution of (7.1.11). Now let (1) = 1, #(2) = x(1)/z(1), 


x(3) = x(2)/z(2), and so on. Then x(n) is a nonoscillatory solution of 
(7.1.1). 


=Ñ; 


For the special case where p(n) = p is a constant real number we have 
the following stronger result. 


Theorem 7.7. Consider the equation 
x(n ++ 1) — z(n) + pz(n — k) = 0, (7.1.14) 


where k is a positive integer and p is a nonnegative real number. Then every 
solution of (7.1.14) oscillates if and only if p > k*/(k+1)**?. 


PROOF. Combining the results of Corollary 7.4, Example 7.5, and 
Theorem 7.6 yields the proof. 
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Remark: Gyori and Ladas [63] showed that every solution of the kth-order 
equation 

a(n+k)+pia(n+k—-1)+---+ppa(n) =0 (7.1.15) 


oscillates if and only if its characteristic equation has no positive roots. 
Based on this theorem (Exercises 7.1, Problem 8), they were able to show 
that every solution of the three-term equation (7.1.14), where k € Z - 
{—1,0}, oscillates if and only if p > k*/(k + 1)**1. 


Exercises 7.1 


1. Find the limit superior and limit inferior of the following sequences: 


(b) Sg: (—1)""1. 
(c) S3: an/(1+ Bn). 
(da) Sg:1+(-1)""?. 
2. Prove the following statements: 
(a) fim sup(1/a(n)) = 1/lim inf a(n). 


(b) If a(n) > 0, then limsup(—a(n)) = — lim inf a(n). 


noo n> 


(c) liminf a(n) < lim sup a(n). 
n— o0 n= 


3. Show that the difference equation 
A°r(n—1)+ x(n) =0, n>1, 
is oscillatory on [0, 00). 
4. (a) Show that every solution of the equation 
a(n +1) — a(n) + pa(n) = 0 
oscillates if and only if p > 1, where p E€ R. 
(b) Show that every solution of the equation 
x(n + 1) — a(n) + px(n—1) =0 
oscillates if and only if p > 4. 
5. Consider the difference equation 
A?x(n) + p(n)a(n +1) =0, 


where p(n) > a > 0 for n € Z*. Show that every nontrivial solution of 
the equation is oscillatory. 


wa 


aD 


. Prove part (ii) of Theorem 7.3. 
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7. The characteristic equation of (7.1.14) is given by 
At _ )\F 45 =0, where p> 0. 


Show that the characteristic equation has no positive roots if and only 
if p > k*/(k+1)**!. Then give a proof of Theorem 7.7. 


8. Show that every solution of (7.1.15) oscillates if and only if its 
characteristic equation has no positive real roots. 


*9, [53] Assume that 
liminf p(n) = q > 0, 
noo 
and 


lim sup p(n) > 1 — q. 


n— o0 


Prove that all conclusions of Theorem 7.3 hold. 


In Problems 10 through 12 consider the equation with several delays 
z(n+1)-— in) + Dot kj) =0, (7.1.16) 


where kj are positive integers. 
10. Suppose that p;(n) > 0 and 
(ki +1)* =] 
lim inf p(n [E Sl. 
> (a 
Show that every solution of (7.1.16) oscillates. 
11. Suppose that p;(n) > 0 and 


lim inf do Pi(n) > 
= 
where k = min{k,,k2,...,km} > 1. Show that every solution of 


(7.1.16) oscillates. 
*12. Suppose that 


nat Se) =c>0 
and 
limsup $` p;(n) =l-c 


Prove that every solution of (7.1.16) oscillates. 
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7.2 Self-Adjoint Second-Order Equations 


In this section we consider second-order difference equations of the form 
A[p(n — 1)Aa(n — 1)] + ¢(n)a(n) = 0, (7.2.1) 


where p(n) > 0,n € Zt. Equation (7.2.1) is called self-adjoint, a name 
borrowed from its continuous analogue 


[PEL (t) + q(t)a(t) = 0. 


Equation (7.2.1) may be written in the more familiar form 


p(n)a(n + 1) + p(n — 1)a(n — 1) = d(n) a(n), (7.2.2) 
where 
b(n) = p(n — 1) + p(n) — a(n). (7.2.3) 
As a matter of fact, any equation of the form 
po(n)a(n + 1) + pi(n)a(n) + po(n)a(n — 1) = 0, (7.2.4) 


with po(n) > 0, and pe(n) > 0, can be written in the self-adjoint form 
(7.2.1) or (7.2.2). To find p(n) and q(n) from po(n),pi(n), and po(n), 
multiply both sides of (7.2.4) by a positive sequence h(n). This yields 


po(n)h(n)a(n + 1) + pi(n)h(n)a(n) + po(n)h(n)a(n-—1)=0. (7.2.5) 
Comparing (7.2.5) with (7.2.2), we obtain 
p(n) = po(n)h(n), 
p(n — 1) = pa(n)h(n). 


Thus 
p2(n + 1)h(n + 1) = po(n)h(n), 
or 
_4\ _ Poln) 
h(n+1)= BGs Ti (7.2.6) 
Hence 
i= ii Po(J) 
feng PO +1) 
is a solution of (7.2.6). This gives us 
ae = polj) 
p(n) = pol IE mG +) 


Also from (7.2.3) we obtain 
q(n) = pi(n)h(n) + p(n) + p(n — 1). 
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In [64] Hartman introduced the notion of generalized zeros in order to 
obtain a discrete analogue of Sturm’s separation theorem in differential 
equations. Next we give Hartman’s definition. 


Definition 7.8. A solution x(n),n > no > 0, of (7.2.1) has a generalized 
zero at r > no if either x(r) = 0 or x(r — 1)a(r) < 0. In other words, a 
generalized zero of a solution is either an actual zero or where the solution 
changes its sign. 


Theorem 7.9 (Sturm Separation Theorem). Let x1(n) and x(n) 
be two linearly independent solutions of (7.2.1). Then the following 
statements hold: 


(i) ai(n) and x2(n) cannot have a common zero, that is, if x1(r) = 0, 
then x2(r) #0. 


(ii) If x(n) has a zero at nı and a generalized zero at no > nı, then x2(n) 
must have a generalized zero in (n1, no]. 


(iii) If xi(n) has generalized zeros at nı and no > nı, then x(n) must have 
a generalized zero in [ny, no]. 


PROOF. 


(i) Assume that 21 (r) = xə(r) = 0. Then the Casoratian 


W(r) = «1(r) tar) | _ o 
ti(r+1) a(r+1) 
It follows from Corollary 2.14 that xı(n) and 22(n) are linearly 
dependent, a contradiction. 


(ii) Assume that 21(n1) = 0,21(n2—1)x(n2) < 0 (or 21(n2) = 0). We may 
assume that ng is the first generalized zero greater than nı. Suppose 
that x(n) > 0 for ny <n < ng and x1(n2) < 0. 


Now, if x2(n) has no generalized zeros in (n1, n2], then x2(n) is either 
positive in [n1, no] or negative in [n1, n2]. Without loss of generality let 
x2(n) > 0 on [n1, n2]. Now pick a positive real number M and r € (nj, n2) 
such that xə(r) = May(r) and x2(n) > Max 1(n) in [n1, n2]. By the principle 
of superposition, the sequence x(n) = x2(n) — Mx (n) is also a solution of 
(7.2.1) with z(r) = 0 and a(r — 1)a(r+1) > 0, with r > nı. Letting n =r 
in (7.2.1) we obtain 

A[p(r — 1)Az(r — 1)] + q(r)a(r) = 0. 
Since x(r) = 0, we have 
p(r —1)A?a(r — 1) + Az(r)Ap(r — 1) = 0, 
or 


p(r)a(r + 1) = —p(r — 1)a(r — 1). (7.2.7) 
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Since z(r +1) 4 0,a(r — 1) # 0, and p(n) > 0, equation (7.2.7) implies 
that z(r — 1)a(r +1) < 0, which is a contradiction. This completes the 
proof of part (ii). The proof of part (iii) is left to the reader as Exercises 
7.2, Problem 6. 


Remark: Based on the notion of generalized zeros, we can give an alterna- 
tive definition of oscillation. A solution of a difference equation is oscillatory 
on [n2,00) if it has infinitely many generalized zeros on [no,oo). An im- 
mediate consequence of the Sturm separation theorem (Theorem 7.9) is 
that if (7.2.1) has an oscillatory solution, then all its solutions are oscil- 
latory. We caution the reader that the above conclusion does not hold in 
general for non-self-adjoint second-order difference equations. For example, 
the difference equation x(n + 1) — x(n — 1) = 0 has a nonoscillatory so- 
lution x(n) = 1 and an oscillatory solution x(n) = (—1)". Observe that 
this equation is not self-adjoint. We are now ready to give some simple 
criteria for oscillation. 


Lemma 7.10. If there exists a subsequence b(n) < 0, with nk > œ as 
k > œ, then every solution of (7.2.2) oscillates. 


Proor. Assume the contrary, that there exists a nonoscillatory solution 
x(n) of (7.2.2). Without loss of generality, suppose that x(n) > 0 for n > N. 
Then 


p(nx)a(ng +1) + pnp — 1)z(nk — 1) — b(ng)e(nk) > 0, for nk >N, 


which is a contradiction. 


One of the most useful techniques in oscillation theory is the use of the so- 
called Riccati transformations. We will introduce only one transformation 
that is needed in the development of our results. Two more transformations 
will appear in the exercises. In (7.2.2) let 


b(n + 1)a(n + 1) 


z(n) = pinata) (7.2.8) 
Then z(n) satisfies the equation 
1 
c(n)z(n) + =a) =]; (7.2.9) 
where 
e(n) = A (7.2.10) 


b(n)b(n +1) 
Next we give a crucial result that relates (7.2.2) with (7.2.9). 


Lemma 7.11. Suppose that b(n) > 0 forn € Z*. Then every solution 
x(n) of (7.2.2) is nonoscillatory if and only if every solution z(n) of (7.2.9) 
is positive for n > N, for some N > 0. 
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PROOF. Suppose that x(n) is a nonoscillatory solution of (7.2.2). Then 
x(n)a(n +1) > 0 for n > N. Equation (7.2.8) then implies that z(n) > 0. 
Conversely, assume that z(n) is a positive solution of (7.2.9). Using this 
solution we construct inductively a nonoscillatory solution a(n) of (7.2.2) 
as follows: Let z(N) = 1,2(n+1) = (p(n)/b(n +1))z(n)z(n), with n > N. 
Then one may verify that x(n), with n > N, is indeed a solution of (7.2.2) 
that is nonoscillatory. By the Sturm separation theorem, every solution 
of (7.2.2) is thus nonoscillatory. We need a comparison result concerning 
(7.2.9) that will be needed to establish the main result of this section. 


Lemma 7.12. If c(n) > a(n) > 0 for alln > 0 and z(n) > 0 is a solution 
of the equation 


c(n)z(n) + ———~ = 1, (7.2.11) 


then the equation 


a(n)y(n) + oh zi (7.2.12) 


has a solution y(n) > z(n) > 1 for alln € Zt. 
PROOF. Since c(n) > 0 and z(n) > 0, it follows from (7.2.1) that 1/(z(n— 
1)) < 1. This implies that z(n — 1) > 1 for all n > 1. We now define 


inductively a solution y(n) of (7.2.12). Choose y(0) > z(0) and let y(n) 
satisfy (7.2.11). Now, from (7.2.12) and (7.2.12), we have 


1 1 
So 
a(1)y(1) + > = e(1)2(1) + a. 
D ) z(0) 


Since y(0) > z(0), we have 1/y(0) < 1/z(0), and hence a(1)y(1) > c(1)z(1), 


Inductively, one may show that 


y(n) > z(n) > 1. 


Theorem 7.13. Jf b(n)b(n +1) < (4—€)p?(n) for some £ > 0 and for all 
n> N, then every solution of (7.2.2) is oscillatory. 


PROOF. If b(n)b(n—1) < (4—e€)p?(n) for some e > 4, then b(n)b(n—1) < 
0. The conclusion of the theorem then follows from Lemma 7.10. Hence we 
may assume that 0 < € < 4. Now assume that (7.2.2) has a nonoscillatory 
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solution. Then by Lemma 7.11, (7.2.9) has a positive solution z(n) for 
n > N. Using the assumption of the theorem in formula (7.2.10) yields 
2 2 
1 
E ie SOY Je A 
b(n)b(n +1) ~ (4-e)p2(n) 4-e 
Then it follows from Lemma 7.12 that the equation 


1 1 

y(n) 4 =1 7.2.13 
(n+ (7.2.13) 

has a solution y(n),n > N, such that y(n) > z(n) > 1 for aln > N. 

Define a positive sequence x(n) inductively as follows: (N) = 1,a(n+1) = 


(1/V/4 — €)y(n)a(n) for n > N. Then 
1 
y(n) = V4—€ (4) (7.2.14) 
a(n) 
Substituting for y(n) in (7.2.14) into (7.2.18) yields z(n+1)— v4 — ex(n)+ 
x(n — 1) =0, n > N, whose characteristic roots are 
ee ae ge 
Hen Tee 2 
Thus its solutions are oscillatory, which gives a contradiction. The proof of 
the theorem is now complete. 


It is now time to give some examples. 


Example 7.14. Consider the difference equation 


y(n+1)+y(n—-1) = (2 + (-0") y(n). 


Here p(n) = 1 and b(n) = (2+ $(-1)”): 


b(n) b(n +1) = (2+ 56D") (2+ zn) 
=35. 


Thus b(n) b(n + 1) < (4-4) p?(n). By Theorem 7.13, we conclude that 
every solution is oscillatory. 


The following example will show the sharpness of Theorem 7.13 in the 
sense that if £ is allowed to be a sequence tending to zero, then the theorem 
fails. 


Example 7.15 [67]. Consider the equation 
x(n+1)+ a(n) = b(n) a(n—-1), n=1,2,3,..., 


where 


_ Yn+14+J/n-1 


b(n) a 
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Now, 

b(n)b(n + 1) 

JV(n+1)(n+2)4+ y(n- 1)(n+2)+ Sn(n +1) + ynn- 1) 
n(n +1) 


But limno b(n)b(n + 1) = 4. Hence if one takes €n = 4 — b(n)b(n + 1), 
then €n —> 0 as n > co. However, Theorem 7.13 fails, since x(n) = /n,n > 
1, is a nonoscillatory solution of the equation. 


A partial converse of Theorem 7.13 now follows. 


Theorem 7.16. If b(n)b(n +1) > 4p?(n) forn > N, then every solution 


of (7.2.2) is nonoscillatory. 
PROOF. From formula (7.2.10) and the assumption we obtain c(n) < 4. 
We now construct inductively a solution z(n) of (7.2.9) as follows: Put 


z(N) = 2, and 


Observe that 


2(N+1)= IND (1 am) >4(1- z) =2. 


Similarly, one may show that z(n) > 2 for n > N. Hence by Lemma 7.11, 
we conclude that every solution of (7.2.2) is nonoscillatory. 


Example 7.17. Consider the difference equation 
1 
A(nAa(n — 1) — in) =0. 
Here p(n) = n+ 1 and q(n) = +. Using formula (7.2.3) we obtain 


1 
b(n) = 2n4+14+-. 
n 


b(n)b(n + 1) = | 2n+14 ~) (2n +34 =) 
2n +4 
n(n +1) 
> 4p?(n) for alln > 1. 


= 4n? + 8n+74 


Hence by Theorem 7.16, every solution is nonoscillatory. 


Exercises 7.2 
In Problems 1 through 5 determine the oscillatory behavior of all solutions. 


1. A[(n—1)a(n — 1)] + 42(n) = 0. 
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Bw y 


10. 


*11. 


12. 


13. 


14. 
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a(n +1) +a(n—1) = (2—- +) a(n) 
a(n+1)+a(n—1) = (2+ 4) a(n). 
. A? {a(n — 1)] + alin 2(”) =0, n>1 


. Al(n — 1)a(n — 1)] + z(n) = 0. 
. Prove part (iii) of Theorem 7.9. 
. [112] Show that if b(n) < min{p(n), p(n — 1)} for n > N, for some 


positive integer N, then every solution of (7.2.2) is oscillatory. 


. Show that if b(n) < p(n) and p(n) is eventually nonincreasing, then 


every solution of (7.2.2) is oscillatory. 


. Show that if b(n) < p(n — 1) and p(n) is eventually nondecreasing, 


then every solution of (7.2.2) is oscillatory. 
(A second Riccati transformation). Let z(n) = z(n+1)/z(n) in (7.2.2). 
(i) Show that z(n) satisfies the equation 


p(n)z(n) + w = b(n). (7.2.15) 


(ii) Assuming p(n) > 0, show that every solution of (7.2.2) is nonoscil- 
latory if and only if (7.2.15) has a positive solution z(n),n > N, 
for some N > 0. 


Use the second Riccati transformation in Problem 10 to show that if 
b(n) < p(n — 1) and limsup(p(n))/p(n — 1) > 4, then every solution 
noo 


of (7.2.2) oscillates. 


[67] Show that if b(n) > max{p(n— 1), 4p(n)}, for all n > N, for some 
N > 0, then every solution of (7.2.2) is nonoscillatory. 


Show that if p(n) > b(np)b(ng + 1) for a sequence nz — oo, then 
every solution of (7.2.2) is oscillatory. 


As in formula (7.2.10), let 


p(n) 
c(n) = B(n)o(n + 1)” n> 0. 


Show that either one of the following implies that every solution of 
(7.2.2) oscillates: 


(i) limsupc(n) > 1. 
n— o0 


(ii) limsup 4 X; c(j) > 1. 
noo 
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15. Show that if p(n) is bounded above on [a, oo) and (7.2.1) is nonoscilla- 
tory on fa, o0), then either 5 > gq(n) exists and is finite or it is equal 
n=a+1 
to —o. 


16. Use Problem 15 to prove that (7.2.1) is oscillatory if either one of the 
following conditions hold: 


(i) p(n) is bounded on [a,oo) and >> q(n) =o, or 
n=a+1 


(ii) p(n) is bounded on fa, oo) and 
s=a+1 a s=a+1 


7.3 Nonlinear Difference Equations 


In this section we will investigate the oscillatory behavior of the nonlinear 
difference equation 


x(n + 1) — a(n) + p(n) f(a(n — k)) = 0, (7.3.1) 


where k € Zt and N € Z+. The first theorem is due to Erbe and Zhang 
[53]. 


Theorem 7.18. Suppose that f is continuous on R and satisfies the 
following assumptions: 


(i) af@)>0, «#0, 


(ii) liminf 1) =L, 0<L<oo, 
pam 

see k . . . . 

(iii) 4 > TFI if k > 1 and pL >1if k= 0, where p = lim inf p(n) > 


Then every solution of (7.3.1) oscillates. 


PROOF. Assume the contrary and let x(n) be a nonoscillatory solution of 
(7.3.1). Suppose that x(n) > 0 for n > N. This implies by assumption (i) 
that f(a(n)) > 0. Hence a(n +1) —a(n) = —p(n) f(a(n—k)) < 0, and thus 
x(n) is decreasing. Hence limno x(n) = c > 0. 

Taking the limit of both sides of (7.3.1) yields f(c) = 0, which by as- 
sumption (i) gives c = 0. Hence limno £(n) = 0. Dividing (7.3.1) by x(n) 
and letting z(n) = 2(n)/a(n + 1) > 1 yields 


HSE asp sae ee) 
°C a p(n)z(n — 1) +++ 2(n = k) ose (7.3.2) 
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Let lim inf z(n) = r. By taking the limit superior in (7.3.2) we obtain 
n— o0 


sii 


< 1— pLr*, 
or 


r—1 
pL S a (7.3.3) 
It is easy to see that the function h(r) = (r—1)/r**? attains its maximum 
at r = (k +1)/k, and its maximum value is thus k*/(k + 1)*+1!. Hence 


inequality (7.3.3) becomes 


kk 
j DA 
PH S RFI 


which contradicts assumption (iii). 


Remark: If we let liminf f(x)/x = 1, then the linearized equation associated 
n— o0 


with (7.3.1), where p(n) is equal to a constant real number p, is given by 
y(n + 1) — y(n) + py(n — k) = 0, (7.3.4) 


which has been studied in Section 7.1. We may now rephrase Theorem 
7.18 as follows: Suppose that assumptions (i) and (ii) hold with L = 1 and 
that p(n) is constant. If every solution of (7.3.4) oscillates, then so does 
every solution of (7.3.1). Gyori and Ladas [63] considered the more general 
equation with several delays 


a(n+1)— a(n) + X pifi(a(n — k;)) =0, (7.3.5) 
i=1 
where p; > 0, k; is a positive integer, and f; is a continuous function on R, 
with 1 < i < m. They obtained the following result. 
Theorem 7.19. Suppose that the following hold: 
(i) pi > 0, ki € Zt, and 7", (Pi + ki) #1,1<i<m, 
(ii) f is continuous on R, and xfi(x) > 0, fora #0, 1<i<m, 


(iii) lim inf 2 >1, 1<i<m, 
x—>0 


iv) YE p ERE ~], 


i=1 Pi Fi 
Then every solution of (7.3.5) oscillates. 
To facilitate the proof of this theorem we present the following lemma. 


Lemma 7.20 [63]. Suppose that condition (i) in Theorem 7.19 holds and 
let {qi(n):1 <i <m} be a set of sequences of real numbers such that 


liminf g(n) > pj, 1<i<m. (7.3.6) 
noo 
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If the linear difference inequality 
a(n +1) )+ 2 qi(n)ja(n— k;) <0, neZt, (7.3.7) 


has an eventually positive solution x(n), then the corresponding limiting 
equation 


y(n +1) — (0) + pl n—kj) =0 (7.3.8) 


also has an eventually positive solution. 


Proor. ‘There are two distinct cases to consider 
Case (a): Assume that k; = 0, 1 < i < m. Then (7.3.7) and (7.3.8) 
simplify to 


u(n+1)< (: — 2 a(n) x(n), (7.3.9) 
y(n+1)= (: = Sn] y(n). (7.3.10) 


Let x(n) be an eventually positive solution of (7.3.9). Then from (7.3.9) it 
follows that, for sufficiently large n, 


Sao) <1. (7.3.11) 


Now, from assumption (7.3.6) for any £ > 0 there exists N > 0 such that 


0<p<a(n)+e/m forn>N. (7.3.12) 
This implies that 


0< ms Dal )+e<1+e forn>N. 
Since £ was arbitrarily chosen, 
m 
0< Xp <l. 
i=1 
But from assumption (i) in Theorem 7.19, we have 57)", pi # 1. Hence 
m 
0< `p <1, 
i=1 


and consequently, (7.3.10) has a positive solution. 
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Case (b): Assume that k = max{k1,ko,...,km} > 1. Let u(n) = 
x(n)/a(n — 1). Then 


x(n — ki) a(n—k;) a(n—k+1) a(n—-2) mS 1 
x(n — 1) a(n—ki +1) 2(n—kj +2) =I] n—j) 


j=l 
Making this change of variables in (7.3.7) yields 


m ki—1 
u(n +1) < 1- J aln © Iaa AOE (7.3.13) 


Define u = limsup u(n). Then it follows from (7.3.13) that 0 < u(n) < 1 
n= o0 
and 0 < u < 1. We claim that 


u-1+S pu™ <0. (7.3.14) 


Now, from (7.3.6), for every £ € (0,1) there exists Ns > 0 such that P;(n) > 
(l—e)pi, 1 < i < m, and n> Ne. Substituting in (7.3.13) yields 


m ki—1 
1 


i=1 j=1 


Choose Ñ, such that Ñ- > N- + k and 
u(n) < (1—e)u forn > Ñ: —k. 
Then, for n > Nex k, 


u(n+1)<1-(1-¢) yua (14e). 


i=l 


Consequently, 
u<1-(l1-e) Sopar (1+8) ki, 


Since € was arbitrarily chosen, it follows that 


m 
u<1-S pu, 
t=1 


which proves claim (7.3.14). 
To complete the proof of the lemma we consider the characteristic 
polynomial of (7.3.8), p(A) = àA — 1 + 372, pid ™ 
Observe that p(0*) = œ and p(u) < 0. This implies by the intermediate 
value theorem that p(A) has a positive root and, consequently, (7.3.8) has 
a positive solution. 
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PROOF OF THEOREM 7.19. Assume that (7.3.5) has a nonoscillatory 
solution x(n). Without loss of generality, assume that a(n) is eventu- 
ally positive. Then it follows from assumption (iii) that a(n + 1) < 
x(n) — 0", piz(n — kj). As in the proof of Theorem 7.18, one may show 
that Jim x(n) = 0. We now need to put (7.3.5) in the form of (7.3.7). This 


CO 
can be accomplished by setting 


Thus from assumption (iii) we obtain 
liminf gi(n) > pi- 
By Lemma 7.20, it follows that the limiting equation (7.3.8) also has an 


eventually positive solution, which is a contradiction. This completes the 
proof of the theorem. 


In fact, under additional conditions it was proved ([63, , Corollary 7.4.1]) 
that every solution of the nonlinear equation oscillates if and only if every 
solution of the corresponding linearized equation oscillates. 

We now apply the obtained results to study the oscillatory behavior of 
the Pielou logistic delay equation. The stability of this equation has been 
determined previously in Example 4.37. 


Example 7.21 [63]. Consider the Pielou logistic delay equation 


ay(n) PAE 
1) = —— A 1 0, k sit t . (7.3.15 
y(n +1) TF bylin K)’ a>1,8 >00, a positive integer. ( ) 
Show that every positive solution of (7.3.15) oscillates about its positive 
equilibrium point y* = (a — 1)/8 if 


a-1l a kk 
a (k+1)F+1° 


Solution We follow Method 2 in Example 4.37 by letting y(n) = ((a — 
1)/B)e"™ in (7.3.15). We obtain the equation 


(7.3.16) 


Hoist) ate 2l F(o(n—k)) =; (7.3.17) 


where 


mae Oe ae (= 1)e” + =) l 


a-l a 


It may be shown that the function f satisfies conditions (i) and (ii) in 
Theorem 7.18 with L = 1. Hence by Theorem 7.18 every solution of (7.3.17) 
oscillates about 0. This implies that every solution of (7.3.15) oscillates 
about the equilibrium point y* = (a — 1)/f. 
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Exercises 7.3 
1. Consider the difference equation 
Aa(n) +e") —1=0. 
Determine the oscillatory behavior of all solutions. 


2. Consider the difference equation 
x(n + 1) = x(n) exp i (1 — z%)] , r>0, a>O0, 2«(0)>0. 
a 


(a) Show that «* = a is the only positive equilibrium point. 
(b) Show that every solution oscillates about a if r > 1. 
(c) Show that if r = 1, every solution converges monotonically to a. 


3. Consider the difference equation 


eD], r>0, a>0, x(0)>0. 


x(n + 1) = 2(n) exp i (: aes 


Show that every solution oscillates about x* = a if r > 4. 


4. Consider the difference equation 


a(n +1) = 2(n) exp i ( La 1) aa 2) ; 


r>0, a>0, 8>0, <x(0)>0. 


Show that every solution oscillates about x* = (aß)/(a + 8) if r > 
4(a + B)/(27a + 168). 


5. Consider the difference equation 
Aa(n)+p(1+2(n))a(n)=0, p>0, 1+z(n)>0. 


Show that every solution oscillates if p > 1. 


aD 


. Consider the difference equation 
Ax(n) + p(l+2(n))a(n—1)=0, p>0, 1+2(n)>0. 


Show that every solution oscillates if p > }. 


N 


. [63] Consider the difference equation 
Az(n) + p(n)[1 + a(n)Ja(n—k) =0, p(n) > 0, 


for n > 1, a(n)+1> 0 for n > —k. Prove that every solution oscillates 
if liminf p(n) = c > k¥/((k +1)**?). 
n—->co 


7.3 Nonlinear Difference Equations 333 


8. Consider the difference equation 
ax(n) 
1+ Bu(n—k) + ya(n—- 1) 


witha > 1, 86 >0, y>0, k € Z*. Find conditions under which all 
solutions oscillate. 


a(n+1)= 


8 


Asymptotic Behavior of 
Difference Equations 


In Chapters 4 and 5 we were mainly interested in stability questions. In 
other words, we wanted to know whether solutions of a difference equa- 
tion converge to zero or to an equilibrium point. In asymptotic theory, we 
are concerned rather with obtaining asymptotic formulas for the manner 
in which solutions tend to zero or a constant. We begin this chapter by 
introducing the reader to the tools of the trade. 


8.1 Tools of Approximation 


The symbols ~, o, and O are the main tools of approximating functions and 
are widely used in all branches of science. For the benefit of our readers, 
we shall give our definitions for functions defined on the real or complex 
numbers. Hence sequences will be treated as a special case of the general 
theory. 

We start with the symbol O (big oh). 


Definition 8.1. Let f(t) and g(t) be two functions defined on R or C. 
Then we say that f(t) = O(g(t)), t > œ, if there is a positive constant M 
such that 


IF()| < Mlg(t)| forall t> to. 


Equivalently, f(t) = O(g(t)) if |4 is bounded for t > to. In other 
words, f = O(g) if f is of order not exceeding g. 
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Example 8.2. 
(a) Show that 


4 1 
j} SOL), n > œ, for n € Zt. 
t? +n? i” 


Solution Without loss of generality we assume t > 1. We have t?-++n? = 
(t — n)? + 2nt > 2nt. Hence 


n \" 1 1/1 1 
< = < fi Zt >i, 
(ata) PE, 2r (=) ae a aa 


It follows that 


with the constant M = 1 being independent of n. 


Show that 
1 1 
sin (nn+ =) -o(<), n> OO. 
n n 


Solution Recall that sin (nm + +) = (—1)” sin +. Thus 


S 
S 


sin (nr + +) 2 sin = 
1/n 1/n 
nik l 
If we let u = E, then limno T = lim,_+0 pa = 1: 


Hence we conclude that |(sin +) /(1/ n)| is bounded, which gives the 
required result. 


Show that t? logt + t? = O(t?),t > oo. 


— 
e] 
aar 


t? log t+t? 
t3 


logt 
=14 a 


Solution 


Using the first derivative test one may show that the function y = log t/t 
attains its maximum value + as t = e. Hence |logt/t| < + < 1, and thus 
|(t logt + t?)/t?| < 2. This proves the required result. 


Remark: We would like to point out here that the relation defined by O 
is not symmetric, i.e., if f = O(g), then it is not necessarily true that 
g = O(f). To illustrate this point we cite some simple examples such as 
x = O(x?), x —> œ, but x? + O(x),x > œ, or e~* = O(1),x —> ov, but 
14 O(e~*), £ => œ, since 1/e~* > o0, £ > œ. 

However, it is true that the relation O is transitive, that is to say if 
f = O(g) and g = O(h), then f = O(h) (Exercises 8.1, Problem 1). In this 
case we say that f = O(h) is a better approximation of f than f = O(g). 
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Next we give the definition of the symbol o (little oh). 


Definition 8.3. If limy 5. fu = 0, then we say that 


f(t) = o(g(t)), t= œ. 
Example 8.4. 
(a) Show that t? logt + t? = o(t*),t — oo. 


Plogt+t? |. ogt 
Solution limt5oo ee = limino a + liM o T 
Using L’Hôpital’s rule we have 
. logt : 1 
e T 


Hence 
Plott ti 
j eg 
t— oo t4 


and the required conclusion follows. 


(b) Show that o(g(t)) = g(t)o(1),t > œ. 
Solution Let f(t) = o(g(t)),t > œ. Then 
im f(t) a 
too g(t) 


which implies that ae = 0(1),t > oo. Consequently, f(t) = g(t)o(1), 
t > oo. 


The reader may sense correctly that the symbol o plays a much less 
important role than the symbol O. 


Finally, we introduce the asymptotic equivalence relation ~. 


Definition 8.5. If limi. a = 1, then we say that f is asymptotic to 


g, t + œ, and we write f ~ g,t > œ. 


Notice that if f ~ g as t > o, then 


2 


This implies from Definition 8.3 that f(t) — g(t) = o(g(t)) = g(t)o(1) 
(Example 8.4). Hence we have 
f(t) = gH + o(1)]. 


Thus, it appears that the symbol ~ is superfluous, since, as has been 
demonstrated above, f ~ g can be conveniently written as f = g(1+o0(1)). 
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Example 8.6. 


1 
(a) Show that sinh t ~ ~e’,t > oo. 
sinht ,. (et — e™) 


Solution lim = lim I =p 
t t 


Li Ot 
=> A t> <= 
5 R 2e 


(b) Show that t? logt + t? ~ t3, t > oo. 
Solution 


_ Plogt+t? . logt 
lim 7 = ] + lim 


too t tooo t 


= 1 + 0 (using L’H6pital’s rule) 
=1. 

Notice that from Examples 8.2(c) and 8.6(b) we have t? ~ t? logt + t’ 
and t?logt + t? = O(t?). It is also true that t?logt + 2t? = O(t?), but 
t? logt + 2t3 is not asymptotic to t°, since 

t? logt + 2t? 
lim OBT EAr i 
t— oo t3 


Before ending this section we will entertain the curious reader by intro- 
ducing the prime number theorem, well known in the discipline of number 
theory. It says that the number of primes z(t) that are less than the real 
number t is asymptotic to t/(log t), t > oo, that is, 


Oe 


n logt’ 
For a proof of this result the reader may consult [144]. 
Another interesting asymptotic result is Stirling’s formula 


n! ~n” vV 2rn e", n> oœ. 


t> oo. 


A proof of this formula may be found in [127]. 


Exercises 8.1 
2 


Lee 
2. Show that sinh t = O(e’), t > oo. 
3. Show that O(g(t)) = g(t)O(), t> o. 
4. Show that: 


1. Show that 


+ log(1 +t?) = O(logt), t— oo. 
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1 
5. Show that sinh G) = o(1), t> œ. 


6. Show that: 
(i) [0]? = O(#*) = o(t°), 
(ii) t+ o(t) = O(t). 
7. Show that: 
(i) sin(O(t-4)) = OW, 
(ii) cos(t + a + o(1)) = cos(t + a) + o(1), for any real number a. 
8. Prove that ~ is an equivalence relation. 
9. Prove that both relations o and O are transitive. 


10. Suppose that f(t) = O(t),t + œ, and g(t) = O(t?), t > oo. Show that 
for any nonzero constants a, b,a f(t) + bg(t) = O(g(t)), t > œ. 


11. If f = O(g),t > œ, show that: 
(i) O(o(f)) = o(O(F)) = o(9), 
(ii) O(f)o(g) = o(f)o(g) = ol fg). 


12. Let f be a positive nonincreasing function of t, and let f(t) ~ g(t), 
t + oo. Prove that sups»: f(s) ~ g(t), t > œ. 


13. Suppose that the functions f and g are continuous and have convergent 
integrals on [1, 00). If f(t) ~ g(t),t —> œœ, prove that 


f 1 as~ [gs ds, t— oo. 
t t 
14. Consider the exponential integral E(x) defined by 
E(x) = a o (x > 0), where n is a positive integer. 
(a) Show that En (x) satisfies the difference equation 


En41(£) = L [e™® — xEn(£)] . 


(b) Use integration by parts to show that 


Be ea 


(c) Show that 
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15. Show that 


16. Show that 


8.2 Poincaré’s Theorem 


In this section we introduce to the reader the theorems of Poincaré and 
Perron. Both theorems deal with the asymptotic behavior of linear differ- 
ence equations with nonconstant coefficients. It is widely accepted among 
researchers in difference equations that the theorem of Poincaré [123] 
marks the beginning of research in the qualitative theory of linear differ- 
ence equations. Thirty-six years later, Perron [117] made some significant 
improvements to Poincaré’s theorem. 

To motivate our study we will take the reader on a short excursion to 
the much simpler linear equations with constant coefficients of the form 


a(n+k)+pya(n+k—1)+-+-4+ pea(n) = 0, (8.2.1) 


where the p;’s are real or complex numbers. The characteristic equation of 
(8.2.1) is given by 


Pp hep (8.2.2) 


Let Ai, A2,---,Ax be the characteristic roots of (8.2.2). Then there are two 
main cases to consider. 


Case 1. Suppose that distinct characteristic roots have distinct moduli, i.e., 
if A; Æ Aj, then |A;| Æ |A,| for all 1 < i,j < k. 
For the convenience of the reader we will divide Case 1 into two subcases. 
Subcase (a) Assume that all characteristic roots are distinct. So, by 
relabeling them, one may write the characteristic roots in descending order 
[Ar] > [Al > +++ > [Aal- 
Then the general solution of (8.2.1) is given by 


x(n) = a AT + CoAR A + RNR. (8.2.3) 
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Hence if cı # 0, we have 


: a(n+ 1) g ey + c2A2 T! + vest CRAT! 
lim ——— = lim 
n>œ gln n= oo GAT + C2A3 He + cKAR 
n+1 n+1 
arala eala) 
n co 
OETA 
: Ài À 
=i, since J/—| <1, i=2,...,k. 
Ai 


Similarly, if c1 = 0, c2 4 0, we obtain 
1 
” z(n+ 1) 


li = do. 
n>% £(n) ? 

And, in general, if c1 = cg = -+ - = ci—1 = 0, c Æ 0, then 
jie Sy 


Subcase (b) Now suppose that there are some repeated characteristic 
roots. For simplicity assume that A; is of multiplicity r, so Ay = Az =- = 
Ap; [Ar] = [Ao] = +++ = Ar| > Arl > +++ > [Ak]. Then the general solution 
of (8.2.1) is given by 

a(n) = (c1 + en +++ t ern" THAT + Crp Any bee + KAR. 

Then one may show easily that this case is similar to Subcase (a) (Exercises 
8.2, Problem 1). 

Case 2. There exist two distinct characteristic roots Ar, A; with |A,| = [Az]. 
This may occur if A, and A; are conjugates, i.e., Ar = a+iß, àj = a—i for 
some real numbers a and (@. For simplicity, let us assume that r=1,7 = 2, 
so A, = Ay and Aj = Ag. We write Ay = a +718 = re? dy =a— ib = re”, 
where r = (a? +8?) "2,0 = tan! (2). Then the general solution of (8.2.1) 
is given by 


x(n) = arret? + egr eT? + C3 A3 +e + KAR. 


= lim cree er + cge nt?) + cgAgtt 4 e+ Cra 
noo r? (cet? + cge7in®) +4 c3\R TE CRA” 


(8.2.4) 
Since et”? = cosné + isin nd, e = cosné — isinné do not tend to 
definite limits as n + oo, we conclude that the limit (8.2.4) does not exist. 
For particular solutions the limit may exist. For example, if |A| = |A2| > 
[As] > ++: > [Ak], and 


—ind 
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_ ee ae 
(a) cı £0,co = 0, then any = re” = 4, 
+1 À 
(b) c = 0, c2 Æ 0, then lim snt) = ret? = do. 


n= oo x(n) 


Case 2 may also occur if A; = —Aj. It is left to the reader as Exercises 8.2, 
Problem 2, to verify that in this case, too, limp. «(n+ 1)/x(n) does not 


exist. 


We now summarize the above discussion in the following theorem. 


Theorem 8.7. Let x(n) be any nonzero solution of (8.2.1). Then 


fine A 
n—0o x(n) 


(8.2.5) 


for some characteristic root Am, provided that distinct characteristic roots 
have distinct moduli. Moreover, if there are two or more distinct roots Ar, Àj 
with the same modulus (|A,| = |Aj|), the limit (8.2.5) may not exist in 
general, but particular solutions can always be found for which the limit 


(8.2.5) exists and is equal to a given characteristic root Am. 
Example 8.8. Consider the difference equation 
x(n +2) + pa(n) = 0. 
(a) If u = 8?, then the characteristic equation is given by 
X+ =0. 


Hence the characteristic roots are A; = Bi = Ge'”/? and Az = 
Ge-‘"/?, The general solution is given by 


a(n) = cy br eT? a Goren, 


So 


s(n + 1) C= is — 


cyeinn/2 “iI coe int /2 


—Bi = 


which does not exist. However, if we pick the particular solution 


Fn) = c1 0'e"? 
then 


pe ean 
n—0o T(n) 


= Bein /? = Bi. 


Similarly, for the solution #(n) = c23"e7"7/?, 
a( 


z n+ 1) 
lim ———*+ 
n= oo &(n) 


= —ĝi. 
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(b) If u = —8?, then the characteristic roots are A; = 3,2 = —68. The 
general solution is given by x(n) = c18” + c&2(— 6)". 


Hence 
1 n+l —ANA\n+l 
lim air ae lim O18 ca(— 8) 
n>% æ(n) n>% €1 8" + c2(—B)” 
ifs —q1\n+1 
Sip tine eS) (8.2.6) 


n=>œ Cy + C2(—1)” i 


The limit (8.2.6) does not exist, since x(n + 1)/ax(n) oscillates between 
B(cı + c2)/(c1 — c2) and 8(cı — c2)/(c1 + c2). Notice that for the solution 
T(n) = cB", 


In 1885 the French mathematician Henri Poincaré [123] extended the 
above observations to equations with nonconstant coefficients of the form 


a(n+k)+pi(n)a(n+k—1)+--++ pe(n)a(n) =0 (8.2.7) 
such that there are real numbers p;,1 < i < k, with 


lim p;(n) = pi, Ll<i<k. (8.2.8) 
noo 
We shall call an equation of the form (8.2.7), (8.2.8) a difference equation 
of Poincaré type. The characteristic equation associated with (8.2.7) is 


AF + pià! +- + pp = 0. (8.2.9) 


The underlying idea behind Poincaré’s theorem is that since the coefficients 
of a difference equation of Poincaré type are nearly constant for large n, 
one would expect solutions of (8.2.7) to exhibit some of the properties of 
the solutions of the corresponding constant coefficient difference equation 
(8.2.1) as stated in Theorem 8.7. 


An important observation which carries over from autonomous to nonau- 
a(n+1) __ 
a(n) 


tonomous systems is the following. If lim a, then a must be a 
noo 


characteristic root, i.e., a root of (8.2.9). 


Theorem 8.9 (Poincaré’s Theorem). Suppose that condition (8.2.8) 
holds and the characteristic roots Ay, 2,...,An of (8.2.9) have distinct 
moduli. If x(n) is a solution of (8.2.7), then either x(n) = 0 for all large 
n or 
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P x(n + 1) 
n—0o x(n) 


=); (8.2.10) 


for somei, 1<i<k. 


Proor. The proof will be given in Section 8.8. 


Note that Poincaré’s Theorem does not tell us whether or not each char- 
acteristic root A; can be written in the form (8.2.10). In 1921, Oscar Perron 
[117] gave an affirmative answer to this question. 


Theorem 8.10 (Perron’s First Theorem). Assume that p(n) 4 0 
for alln € Z* and the assumptions of Theorem 8.9 hold. Then (8.2.7) has 


a fundamental set of solutions {x1(n),v2(n),...,2%(n)} with the property 
i 1 
fy OT Se. Gee, (8.2.11) 
n= xiln) 
PROOF. A proof of this theorem may be found in Meschkowski [99, p. 10]. 


Theorem 8.10 is commonly referred to as the Poincaré-Perron Theorem. 
Perron [117] later formulated and proved a result of a different nature that 
does not suffer from the restriction on the characteristic roots. 


Theorem 8.11 (Perron’s Second Theorem). Suppose that p(n) # 
0 for alln € Z*. Then (8.2.7) has a fundamental set of solutions 
{xi(n),2(n),...,¢~(n)} such that 


lim sup ¥|zi(n)| = |Aijl- (8.2.12) 


It is questionable whether Poincaré—Perron Theorem remains valid if 
(8.2.7) has characteristic roots with equal moduli. Perron himself addressed 
this question and gave the following example, which shows that Poincaré’s 
theorem may fail in this case. 

But in order to understand this example we need to make a detour to 
infinite products. 


8.2.1 Infinite Products and Perron’s Example 


An expression of the form 


Co 


[[G+en)), a(n) 4-1 for allne Zt, (8.2.13) 


n=1 


is called an infinite product. The partial products are [[a + a(j)). The 
j=l 

infinite product (8.2.13) is said to converge if lim; +. Wa + a(j)) is 

finite and nonzero. Otherwise, it is said to be divergent. 
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Theorem 8.12. Consider the infinite series 


3 a(n), (8.2.14) 
S a2(n). (8.2.15) 


Then the following statements hold: 


(i) The convergence of any two of (8.2.13), (8.2.14), (8.2.15) implies that 
of the third. 


(ii) SE |a(n)| converges, then both (8.2.13) and (8.2.15) converge. 
(iii) If (8.2.14) converges conditionally, then: 

(a) (8.2.13) converges if (8.2.15) converges, 

(b) (8.2.13) diverges to zero if (8.2.15) diverges. 


PROOF. See [109]. 


Example 8.13. Consider the difference equation 


x(n + 2) = (1 + E) x(n)=0, n>0. (8.2.16) 


Then the associated characteristic equation of (8.2.16) is A?—1 = 0. Hence 
the characteristic roots are \; = 1 and Ag = —1, with |Ai| = |A2| = 1. We 
now have two cases to consider: 


(i) For n = 2k, x(2k + 2) = (1 + xt) x(2k), and hence 


k 
z(2k)= ] [ (1 + =) a(0). (8.2.17) 


j=l 
(ii) For n = 2k — 1, (2k + 1) = (1 + 4) 2(2k— 1), and hence 
k—1 1 
2(2k — 1) = (1 — =) x(1). (8.2.18) 
1 


Hence 


tin sage. [TL (4+ ayaa) 200 / TE (2) 20 
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In the sequel we will show that this limit does not exist. To accomplish 
this task, we need to evaluate the infinite products 


i (1+ È ) (8.2.20) 


I (1 = =) (8.2.21) 


Let us now apply Theorem 8.12(i) to the infinite product (8.2.20). Since 


wei aa? converges, it follows by Theorem 8.12(i) that if (8.2.20) con- 


verges, then so does )> 


and 


sa aii which is false. Thus the infinite product 
1 
27-1 


Next we consider the infinite product (8.2.21). By a similar argument, 


(8.2.20) diverges to oo, since each term (1 + ) is greater than 1. 


we show that it diverges to zero, since each term (1 — z is less than 1. 
It follows that the limit (8.2.21) does not exist. 


Example 8.14. Consider the difference equation 


x(n + 2)-— 


1 
m punt 1) + ze =0. 
The associated characteristic equation is given by 
W-A=0 


with characteristic roots A; = 1, Ag = 0. Hence by Perron’s theorem there 
exist solutions x1(n), v2(n) such that 


1 

lim an +) =1 and lim 
n—0o x1(n) n—0o x2(n) 

What can we conclude about the solutions x1(n) and x2(n)? The solution 

x1(n) may be equal to a constant c, a polynomial in n such as 


k k-1 
akn + ak-ın +++ + ao, 


or a function such as 4, logn, among others. The solution x2(n) may be 


—n? 


equal to 0, e~?", e~”, etc. 


The reader may correctly conclude from the preceding examples that 
Poincaré’s or Perron’s theorem provides only partial results about the 
asymptotic behavior of solutions of linear difference equations. The ques- 
tion remains whether we can use Perron’s theorem to write an asymptotic 
expression of solutions of equations of Poincaré type. Using null sequences, 
Wimp [145] devised an elegant and simple method to address the above 
question. Recall that v(n) is called a null sequence if lim, +. v(n) = 0. 
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Lemma 8.15. Suppose that limno 27+» = }. 


x(n) 
(a) IfX #0, then 
a(n) = A” e”) (8.2.22) 
for some null sequence v(n). 
(b) If \ = 0, then 
|x(n)| = e7 P/M”) (8.2.23) 
for some positive null sequence u(n). 
PROOF. 
(a) Let 
y(n) = | 
Then 
hm Yet) _ |; a= 
wide y(n) nt |X” a(n) 


Hence for a given € > 0 there exists a positive integer N such that 
|z(n+1)—2(n)|<e/2 foralln>N. 


Moreover, for n > N, we obtain 


n 


(n= Ns SO le(r) — alr Dl < S(n N). 


r=N+1 
Hence 
N N 
wiqi )+/7 | 
n 2 n n 
< = a T= E 
a 
for sufficiently large n. It follows that limp—oo z) = Qor z(n) = nv(n) 


for some null sequence v (n). 


(b) This is left to the reader as Exercises 8.2, Problem 6. 
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Example 8.16. Use Lemma 8.15 and the Poincaré—Perron Theorem to 
find asymptotic estimates of a fundamental set of solutions of the difference 
equation 

2n 


2 han 1) — 
Un?) agi) as 


n+1 


5¥(n) = 0. 
Solution The associated characteristic equation is given by 
Ww +r-2=0 


with roots Ay = 1,A2 = —2. By Perron’s Theorem, there is a fundamental 
set of solutions yı (n), y(n) with 


lim HERY i) =], 
n— oo yı (n) noo yaln) 
Thus by Lemma 8.15 we obtain 
yi(n) =e), yaln) = (2e, 


for some null sequences y(n) and u(n). 
For the curious reader we note that an exact fundamental set of solutions 
is given by 


Exercises 8.2 


1. Prove that each nontrivial solution x(n) of the second-order difference 
equation 


a(n +2) + piz(n +1) 4+ pox(n) = 0 
with double characteristic roots A; = A2 = À satisfies limy—.oo(a(n + 
1))/a(n) = À. 
2. Suppose that the characteristic roots A1, Ag of 
s(n +2) + piz(n+1) + pox(n) =0 


are such that Ay = —A2. Prove that limn.(a(n + 1))/a(n) does not 
exist for some solution x(n). 


3. Consider the difference equation 
a(n+3)—(at+ B+ )a(n+2)+(aB+ By+ya)a(n+1)—aByu(x) = 0, 


where a, 3,7 are constants. 


(a) Show that the characteristic roots are Ay = a, Ag = 8, and A3 = 7. 
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(b) If |a| > |6| > |y], find a fundamental set of solutions xı (n), x2(n), 
and 2#3(n) with 


lim ——— =a, lim ——— 
n—0o x3(n) 


= B, 


(c) If ja] = |B|,a 4 G,la| > |y], find a fundamental set of solu- 
tions xı (n), 2(n), and x3(n) such that limno @1(n+1)/21(n) = 
a, limp soo a(n + 1)/x2(n) = By limp. 13(n + 1)/x3(n) = 7. 
4. Consider the difference equation 
1 n+1 


x(n + 2) 4 (n+1) 


cn ear cl e 


Use iteration to show that limp... x(n + 1)/x(n) does not exist for 
every solution x(n). 


5. Consider the equation 
a(n + 2) — ((n+ 2) + 2(—1)")/(n + 2)?(n + 3)z(n) = 0. 
Use iteration to show that limp_.(a(n + 1))/x(n) does not exist for 
any solution x(n). 
6. Prove part (b) of Lemma 8.15. 
7. Show that the difference equation 


n+ 7 n +1 
nag) 72 rA 1)=0 


has an oscillatory solution and a nonoscillatory solution. 
8. Consider the difference equation 


a(n+2) (s par) eâ aq) ttn) =0. 


(a) Use Lemma 8.15 and Perron’s theorem to find asymptotic 
estimates of a fundamental set of solutions of the equation. 


(b) Verify that zı (n) = 2” and x2(n) = n? constitute a fundamental 
set of solutions. 


9. Let x(n) be a nontrivial solution of (8.2.7) such that limp. £(n + 
1)/x(n) = a. Show that a is a characteristic root, i.e., a root of (8.2.9). 


10. Let œ be a number whose modulus is greater than all of the charac- 
teristic roots of a difference equation of Poincaré type (8.2.7). Prove 
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11. 


12. 


13. 


14. 
15. 
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that 


i ai 


n->co Q” 


for any solution x(n) of the equation. 


Suppose that lim,.. x(n + 1)/z(n) = A > 0. Prove that for any 
ô € (0, A): 


(i) |a(n)| = O(A + ô)”, and 
(ii) (A+ ô)” = O(a(n)). 
Consider the equation a(n + 2) — (n+ 1)a(n + 1) — 2n?x(n) =0. 


(a) Transform the equation into an equation of Poincaré type by 
letting x(n) = (n — 1)! y(n). 


(b) Use part (a) to get an asymptotic estimate of a fundamental set 
of solutions. 


Use the scheme of Problem 11 to find an asymptotic set of a 
fundamental set of solutions of the equation 


s(n +2) + 4°a(n + 1) + 4n(n — 1)x(n) = 0. 
Prove Theorem 8.12. 
Consider the equation 


(n + 2)x(n + 2) — (n+ 3)a(n+ 1) + 2x(n) = 0. (8.2.24) 


(a) Show that 1, 0 are the characteristic roots of the equation. 
(b) Put 
a(n +1) 
x(n) 


in (8.2.23), where u(n) is a null sequence, and show that the 
equation becomes 


=1+ p(n) (8.2.25) 


(n+ 2)u(n+1) =1- ww (8.2.26) 
(c) Show that 
2 
ea ae 2+ O(u(n)). 


(d) Use part (c) to show that (8.2.27) is equivalent to 


(n+ 1) = : o( i ) : (8.2.27) 


n+1 n2 
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(e) Show that 


a(n+1)= 4 (1 + O (=) a(n). (8.2.28) 


(£) Prove that a(n) ~ £,n => oo. 


16. Show that (8.2.24) has another solution 7 ~ eZ, n —> OO. 


17. Use the scheme of Problem 15 to find asymptotic estimates of a 
fundamental set of solutions of the equation 


(n+ 1l)a(n + 2) — (n+ 4)a(n + 1) + 2(n) = 0. 


18. Show that the equation x(n + 2) — (n+ Ll)a(n+ 1) + (n+ 1)z(n) = 0 
has solutions 71(n),22(n) with asymptotic estimates 


x1(n) ~ e(n — 2)!, zə(n) = an, n —> o. 
*19. (Hard). Consider the equation of Poincaré type 
x(n + 2) — (2 + pi(n))a(n + 1) + (1 + po(n))a(n) = 0, 


where p(n) > po(n) for all n € Z*. Show that if x(n) is a solution 
that is not constantly zero for large values of n, then limy—+o(a(n + 


1))/a(n) = 1. 
*20. (Hard). Consider the equation 
x(n +2) + Pi(n)x(n +1) + Po(n)a(n) = 0 


with limno Pi(n) = pr, limno Pe(n) = pe. Let 7 be a positive 
constant such that |a(n + 1)/a(n)|? > |p2| +n for sufficiently large n. 
Suppose that the characteristic roots 1, A2 of the associated equation 
are such that |A| > JA2l. 


Prove that limp. «(rn + 1)/x(n) = A1. 


8.3 Asymptotically Diagonal Systems 


In this section we derive conditions under which solutions of a perturbed 
diagonal system are asymptotic to solutions of the unperturbed diagonal 
system. As a byproduct we obtain asymptotic results for nonautonomous 
kth-order scalar difference equations. 

We begin our study by considering the perturbed diagonal system 


y(n +1) = (D(n) + B(n))y(n) (8.3.1) 
and the unperturbed diagonal system 


x(n +1) = D(n)ax(n), (8.3.2) 
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where D(n) = diag(A1(7), Ao(n),...,An(m)), Ai(n) A 0, for all n > no > 
0,1 < i < k, and B(n) is a k x k matrix defined for n > np > 0. The 
fundamental matrix of system (8.3.2) is given by 


®(n) = diag ( Ul Ar), Ul Alr), Ul ate) (8.3.3) 


Tr=no r=no r=no 


Let S be a subset of the set {1,2,3,...,k}. Define 


i(n) = diag(mı (n), u2(n), - --, up(n)) (8.3.4) 
by letting 
n-1 
[[] X0), ifies, 
[i (7) = | r=no 
0, otherwise. 


Define $2(n) = ®(n) — (n). 
We are now ready for the definition of the important notion of dichotomy. 


Definition 8.17. System (8.3.2) is said to possess an ordinary dichotomy 
if there exists a constant M such that: 


(i) ||}®i(n)@-1(m)|| <M, forn >m > no, 
(ii) |[®2(n)®-1(m)|| < M, for m> n > no. 


Notice that if D(n) is constant, then system (8.3.2) always possesses an 
ordinary dichotomy. 

After wading through the complicated notation above, here is an 
example. 


Example 8.18. Consider the difference system z(n +1) = D(n)a(n) with 


1 
if 0 0 0 

n+1 
Bliss 0 05 0 0 
i 0 0 n+1 0 
1 

0 

n+2 


Then a fundamental matrix of the system may be given by 
n—-1 


(n) = diag | TT (1 + =) oss Ho + Fii (=) 


1 
= i y ! 
diag (n+1,(05) Jnl, y) i 
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From this we deduce that 


®,(n) = diag (o. (0.5)",0, z) 


and 
®2(n) = diag(n + 1,0, n!, 0). 


Finally, 


, (n)b~"(m) = diag (o (0.5), Jo (m+ 5) . 


Hence 
[b(n (m| <1,  forn>m>0. 


Similarly, 


| 
0). for m > n > no. 


[P(A m| < 1, for m > n > no. 


We are now ready to establish a new variation of constants formula that 
is very useful in asymptotic theory. 


Theorem 8.19 (Variation of Constants Formula). Suppose that 
system (8.3.2) possesses an ordinary dichotomy and the following condition 
holds: 


> Bn) < œ. (8.3.5) 


Then for each bounded solution x(n) of (8.3.2) there corresponds a bounded 
solution y(n) of (8.3.1) given by 


y(n) = a(n) + (nG + NBG) 
j=no 2 (8.3.6) 
- Š 8m)" + BUG). 


The converse also holds; for each bounded solution y(n) of (8.3.1) there 
corresponds a bounded solution x(n) of (8.3.2). 


PROOF. Let x(n) be a bounded solution of (8.3.2). By using the method 
of successive approximation, we will produce a corresponding bounded so- 
lution y(n) of (8.3.1). We define a sequence {y;(n)} (i = 1,2,...) by letting 
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— SF (EG + IB) yi(3).- (8.3.7) 


jan 


First we prove that y;(n) is bounded on the discrete interval [no, co). This 
task will be accomplished by induction on 7. From our assumption we have 
lyi(m)| = |a(n)| < c1, for some constant cı. Now assume that |y;(n)| < ci, 
for some constant c;. Then by Definition 8.17 we have 


i(n) Ser + Me; D> BOI = cis. 


J=no 


Hence y;(n) is bounded for each i. 

In the next step we show that the sequence {y;(n)} converges uniformly 
on the discrete interval [ng, 00). 

Using (8.3.7) we have, for i = 1,2,..., 


lyita(n) — yia (o) <M ST Bly) — u) 


J=No 
Hence by induction on i (Exercises 8.3, Problem 8) 
Imin) — y(n) < [MS BOI en. (8.3.8) 
Jj=no 


We choose no sufficiently large such that 


M X` ||BHll=n<1. (8.3.9) 


j=no 


Thus |yi1(n) — yi(n)| < crn’ and, consequently, 377"; {yi+1 (7) — yi(n)} 
converges uniformly on n > no (by the Weierstrass M-test).1 
We define 


y(n) = y(n) + > tuil) — yi(r)} = lim y(n). 


1 Weierstrass M-test: Let un(x),n = 1,2,..., be defined on a set A with 
range in R. Suppose that |un(x)| < Mn for all n and for all x € A. If the series 
of constants °°, Mn converges, then X7] un(x) and XZ; |un(x)| converge 
uniformly on A. 
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Hence |y(n)| < L, for some constant L. Letting i > oo in (8.3.7), we obtain 
(8.3.6). The second part of the proof of the theorem is left to the reader as 
Exercises 8.3, Problem 10. 


If the condition of ordinary dichotomy is strengthened, then we obtain 
the following important result in asymptotic theory. 


Theorem 8.20. Suppose that the following assumption holds: 


(i) Systems (8.3.2) posses an ordinary dichotomy; 


Condition (H) ¢ . 
(ii) lim (n) =0. 
n— o0 


If, in addition, condition (8.3.5) holds, then for each bounded solution x(n) 
of (8.3.2) there corresponds a bounded solution y(n) of (8.3.1) such that 


y(n) = x(n) + o(1). (8.3.10) 


PROOF. Let x(n) be a bounded solution of (8.3.2). Then by using formula 
(8.3.6) we obtain, for a suitable choice of m (to be determined later), 


y(n) = x(n) + #1 (n) D S(j + 1) BUA) y(5) + P(n), (8.3.11) 
where 
(n) $3“ (j+1)B )- Lan H + 1)B(s)y(s). 


j=m 

(8.3.12) 

Now recall that from Theorem 8.20, ||y|| < L, for some L > 0. Hence from 
formula (8.3.12) it follows that 


|Y(n)| < ML $ IIBO)II 


j=m 


Thus for e > 0, there exists a sufficiently large m such that |¥(n)| < 
e/2. Since ®1(n) > 0 as n —> œ, it follows from formula (8.3.11) that 
ly(n) — z(n)| < £, for sufficiently large n. Therefore, y(n) = x(n) + o(1). 

Our next objective is to apply the preceding theorem to produce a dis- 
crete analogue of Levinson’s theorem [91], [36]. We start our analysis by 
making the change of variables 


= II Ai(r)z(n), for a specific i, 1<i< k. (8.3.13) 


Then (8.3.1) becomes 
z(n +1) = (D;(n) + B;(n))z(n), (8.3.14) 
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where 


Associated with (8.3.14) is the unperturbed diagonal system 
a(n+1) = D,(n)a(n). (8.3.15) 
To make the proof of our main theorem more transparent we introduce 


the following lemma. 


Lemma 8.21 [9]. Assumption (H) hold for every equation (8.3.15), 1 < 
i < k, if the following conditions hold. 

There exist constants p > 0 and K > 0 such that for each pair Ai, Aj, 
i Æ j, either 


| Ai(r) 
II — +00, as n > œ, 
o Ail) 
rr |A:(r) 
Condition (L) ¢ and |] L GJ| Z> O forall <m < ne, 
r=n1 J 
or Il Ale) < K, for all O < ny < ng. 
Aj(r) 


r=nıi 


The proof is omitted and left to the reader to do as Exercises 8.3, Problem 
Ta 


Example 8.22. Consider the diagonal matrix 


D(n) = diag(A1(n), A2(n), A3 (n)) 


where 


(i) 


if both nı and nz are even, 


if nı is odd and ng is even or vice versa, 


if both nı and ns are odd, 
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and 
I Ai(7) , 
>œ ano. 
jaer A3(r) 
(ii) 
1, 
~~ 3 if both nı and nz are even, 
Ul Aa(r) | _ oer 
jt M(r) 1 if nı is odd and ng is even or vice versa, 
3 if both nı and nə are odd, 
and 


TT 222] +00 as 200. 


(iii) 


[a2]. sn x, 
r=0 Ài (r) 


but no subsequence of the product converges to zero, and 


TT 222] 4:00 as 24.00, 
r=0 rz (r) 


but no subsequence of the product converges to zero. 


Thus the system æz(n + 1) = D(n)xz(n) satisfies Condition (L) and, 
consequently, it satisfies Condition (H). 


Next we give the fundamental theorem in the asymptotic theory of 
difference equations; the discrete analogue of Levinson’s theorem [91]. 


Theorem 8.23. Suppose that Condition (L) holds and for each i,1 < i < 
k 


>D Tal < 00. (8.3.16) 


Then system (8.3.1) has a fundamental set of k solutions y;(n) such that 


yi(n) = (e; + o(1)) Ul Ailr), (8.3.17) 


r=no 


where e; is the standard unit vector in R® where its components are all 
zero, except that the ith component is 1. 


PROOF. Notice that under Condition (L) it follows from Lemma 8.21 that 
(8.3.15) satisfies Condition (H). Moreover, from assumption (8.3.16), B; (n) 
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satisfies condition (8.3.5). Thus we can apply Theorem 8.20 to (8.3.14) 
and (8.3.15). Observe that since the ith diagonal element in D,(n) is 1, it 
follows that x(n) = e; is a bounded solution of (8.3.15). By Theorem 8.20, 
there corresponds a solution z(n) of (8.3.14) such that z(n) = e; + o(1). 
Now conclusion (8.3.17) follows immediately by substituting for z(n) from 
formula (8.3.13). 


Theorem 8.23 will be referred to as the Benzaid—Lutz theorem. 


Example 8.24. Consider the difference system y(n+1) = A(n)y(n), where 


n? +2 1 

2n2 n3 

A(n) = 0 1 0 
1 

an 0 n 


To apply Theorem 8.23 we need to write A(n) in the form D(n) + B(n) 
with D(n) a diagonal matrix and B(n) satisfying condition (8.3.16). To 
achieve this we let 


1 
1 0S 
5 0 0 ne n3 
0 0 n = 0 0 


Hence Ay = $, A2 = 1, and A3 = n. Thus for ng = 2, our system satisfies 


the hypotheses of Theorem 8.23. Consequently, there are three solutions: 


0 


0 
va~ | [j] Jo] =- io 
1 1 


j=1 


Remark: Before ending this section we make one further comment on the 
conditions in Theorem 8.23. This comment concerns the necessity for some 
condition on B(n) such as (8.3.16). Certainly, condition (8.3.16) holds when 
B(n) = O(n~*),n > œ, for some a > 1, i.e., n“||B(n)|| < L for all 
n > no. On the other hand, the condition B(n) = O(n~') is not sufficient 
for formula (8.3.17) to hold, and a simple example illustrates this point. 
Let us take k = 1,D(n) = 1, and B(n) = +. Then (8.3.1) takes the 


8.3 Asymptotically Diagonal Systems 359 
form y(n +1) = (=) y(n) = (1 + 4) y(n), which has the general solution 
y(n) = cn, for some constant c. Hence no solution satisfies formula (8.3.17). 
Exercises 8.3 


In Problems 1 through 5 find asymptotic estimates (using Theorem 8.23) 
for a fundamental set of solutions of the given system. 


1. y(n +1) = (D(n) + B(n))y(n), where 


3 1 3 

0 o 

Din) = | n72 , BS i 
n 


sinn 
cos mn 0 0 n? en 0 
n n 
D(n) = of, Bin) 0 = 
0 0 3 i o n 
2” n +5 
3. y(n +1) = A(n)y(n), where 
1 
142 
ý n j n(n + 1) 
= 1 
A(n) 0 1 0 
n 
0 0 1+(-1)"cosna 


n én 0 
Am=:| 0 3-0” 0 
oe 0 l+n 


5. Give an example of a two-dimensional difference system where 
Theorem 8.20 does not hold. 


6. Define a diagonal matrix P = diag(a1,a2,..., ap), where 
0 ifigsS, 
Qi = where S' is a subset of the set {1,2,...,k}. 
1 ifteS, 
Prove the following statements: 
(a) P? = P (a projection matriz). 


(b) ®(n)P = (n) as defined in (8.3.4). 
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(c) (n)(I — P) = dan), where a(n) = I — 31 (n). 
(d) ®i(n)P = ©1(n), ®2(n)(I — P) = ®2(n). 
7. Prove Lemma 8.21. 
8. Prove formula (8.3.8) using mathematical induction on i. 


9. Prove that the solution y(n) of (8.3.1) defined by (8.3.6) is bounded 
for n > no > 0. 


10. Prove that under the assumption of Theorem 8.19, for each bounded 
solution y(n) of (8.3.1), there exists a bounded solution x(n) of (8.3.2). 


*11. (Open Problem). Improve Theorem 8.19 by relaxing condition (8.3.5), 


requiring only conditional convergence of Xp n, B(n). 


*12. (Hard). Extend Theorem 8.19 to the case where D(n) is a constant 
matrix in a one-block Jordan form, then extend it to the case when 
D(n) is a constant matrix in the general Jordan form. 


*13. (Hard). Extend Theorem 8.19 to the case where D(n) has an eigenvalue 
equal to zero. 


*14. (Open Problem). Suppose that there are r distinct eigenvalues A1(n), 
A2(n),...,A-(n) with distinct moduli. Prove that with the conditions 
of Theorem 8.19 holding for 1 < i < r, there are solutions y;(n), 
1<i<r, of system equation (8.3.1) that satisfy formula (8.3.12). 


8.4 High-Order Difference Equations 


In this section we turn our attention to the kth-order scalar equations of 
the form 


y(n + k) + (a1 + pilm))y(n + k= 1) +--+ + (ak +pk(n))y(n) = 0, (8.4.1) 


where a; E€ R and p;(n),1 < i < k, are real sequences. As we have seen 
in Chapter 3, (8.4.1) may be put in the form of a k-dimensional system 
of first-order difference equations that is asymptotically constant. Thus we 
are led to the study of a special case of (8.4.1), namely, the asymptotically 
constant system 


y(n + 1) = [A + B(n)ly(n), (8.4.2) 


where A is a k x k constant matrix that is not necessarily diagonal. This 
system is, obviously, more general than the system induced by (8.4.1). The 
first asymptotic result concerning system equation (8.4.2) is a consequence 
of Theorem 8.23. 


Theorem 8.25 [9]. Suppose that the matriz A has k linearly independent 
eigenvectors £1,&,...,& and k corresponding eigenvalues 1, A2,..., Àk- 
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If condition (8.3.16) holds for B(n), then system equation (8.4.2) has 
solutions y;(n), 1 <i < k, such that 


yi(n) = [fi + o(1)]A?- (8.4.3) 


PROOF. In order to be able to apply Theorem 8.23 we need to diagonalize 
the matrix A. This may be accomplished by letting 


y=Tz (8.4.4) 
in (8.4.2), where 


T = (£1, €2,.-+5&%), (8.4.5) 


that is, the ith column of T is &. 
Then we obtain 


Tz(n+1) = [A + B(n)|Tz(n), 


z(n+ 1) = [D + B(n)]z(n), (8.4.6) 


where D = T-!AT = diag(A1, A2,-.., Ax) and B(n) = T-!B(n)T. It is 
easy to see that B(n) satisfies condition (8.3.16). Now formula (8.4.3) 
follows by applying Theorem 8.23. 


Example 8.26. Find an asymptotic estimate of a fundamental set of 
solutions of 


y(n + 1) = [A+ B(n)]y(n), (8.4.7) 


where 


B(n) = 0 (0.2)” 0 
e” 0 log n/n? 
Solution The eigenvalues of A are A; = 5, Ag = 1, and A3 = 1, and the cor- 
1 1 1 
responding eigenvectors are &; = | 1] ,é2 = | 0 |, and & = | 0 
1 —1 —2 


Furthermore, B(n) satisfies condition (8.3.16). Thus by Theorem 8.25, 
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equation (8.4.7) has the solutions 

1 1 
ymn) = (1+ 0(1))(5") | L] ~ | 1] 6"), 
1 


y3(n) =(1+o0(1))} 0 | ~] 0 
29 = 


Next, we apply Theorem 8.23 to establish the following asymptotic result 
for (8.4.1). 


Corollary 8.27. Suppose that the polynomial 
p(d) = àF 4 ay AFT! + «+ + ay (8.4.8) 
has distinct roots A1, A2, ..., Ag and that 


DD |[pi(n)| <œ, forl<i<k. (8.4.9) 
n=1 
Then (8.4.1) has k solutions yi(n), yo(n),..-,yn(n) with 
yi(n) = [1 + o(1)]A?. (8.4.10) 
PROOF. First we put (8.4.1) into the form of a k-dimensional system 
z(n+1) = [A + B(n)]z(n), (8.4.11) 
where 
1 
0 1 
A= , 
—đâk —AkK-1 eee TAL 
0 0 0 
B(n) = 0 0 0 f 
—pr(n) —pr-i(m) ... —pı(n) 


2(n) = (y(n), y(n4+1),...,y(m+k—-1))?. 


Notice that polynomial (8.4.8) is the characteristic polynomial of the matrix 
A. Furthermore, for each eigenvalue A; there corresponds the eigenvector 
&; = (1, Ai, A?,..., 4? 71)". In addition, the matrix B(n) satisfies condition 
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(8.3.16). Hence one may apply Theorem 8.25 to conclude that there are k 
solutions z1(n), z2 (n),..., 2% (m) of (8.4.11) such that, for 1 < i < k, 


yim) 1 

yi(n + 1) ri 

zi(n) = yi(n + 2) = (1+ 0(1))A” ` 
yi(n Lk —1) ye 


Hence y;(n) = [1 + o(1)]A?. 


Example 8.28. Find asymptotic estimates of fundamental solutions to 
the difference equation 


y(n + 3) — (2+ 67") y(n + 2) (1+ oy z) y(n +1) + 2y(n) = 0. 


Solution The characteristic equation is given by \? — 2A? — A + 2 = 0 with 
roots Ay = 2,A2 = 1, A3 = —1. Notice that pı(n) = —e-"~?, po(n) = 
-zm and p3(n) = 0 all satisfy condition (8.4.8). Hence Corollary 8.27 
applies to produce solutions y1(n), y2(n), and y3(n) defined as follows: 


y(n) = [1 + 0(1)]2”,  yə(n)=1+0(1),  ys(n) = [1 + o(1)](-1)”. 


Corollary 8.27 is due to Evgrafov. It says that for each characteristic root 
of polynomial (8.4.8), at least one solution behaves as in formula (8.4.10), 
provided that the rate of convergence of the coefficients is not too slow. 

What happens if all the roots of the characteristic equation (8.4.8) 
are equal? This same question was addressed by Coffman [22], where he 
obtained the following result. 


Theorem 8.29. Suppose that the polynomial (8.4.8) has a k-fold root of 
1 and that 


NO nkl|pi(n)| <œ, forl<i<k. (8.4.12) 
n=1 


Then (8.4.1) has k solutions yi(n), yo(n),..-,yn(n) with 
yi(n) = nt (1 +0(1)), n —> oœ. (8.4.13) 


We remark here that the actual result of Coffman is stronger than the 
statement of Theorem 8.29. Indeed, he proved that 


n i= m 
+o for 1 <m <i, 
i- m n 


i=- m 
o( fori<m<k-1l. 


364 8. Asymptotic Behavior of Difference Equations 


The curious reader might wonder whether Coffman’s theorem (Theorem 
8.29) applies if the polynomial (8.4.8) has a k-fold root not equal to 1. 
Luckily, by a very simple trick, one is able to do exactly that. Assume that 
the characteristic equation (8.4.8) has a k-fold root u Æ 1. Then polynomial 
(8.4.8) may be written as 


(A= p)* =0. (8.4.14) 
Letting y(n) = pu” x(n) in (8.4.1), we obtain 
ptr e(n+k) + pt! (ay +pi(n))e(ntk-1)+ +u” (axtpx(n))x(n) = 0, 


or 
1 1 
Bhar) = Neat pale) nn tk—1)+---4 uF (a, +pp(n))a(n) = 0. (8.4.15) 
The characteristic equation (8.4.15) is given by 
Ape SEPP an E 
m H m 


which has a k-fold root A = 1. Moreover, if pj(n),1 < i < k, satisfies 
condition (8.4.1), then so does (1/p")p;(n). Hence Theorem 8.29 applies to 
(8.4.15) to yield solutions 21(n), x2(n),...,2%(n) with 


a(n) = n?+(14 o(1)), n —> OO. 
Consequently, there are solutions yi (n), y2(n),..., yx(n) of (8.4.1) such that 
yi(n) = nT (1 + o(1))u”. 
We now summarize the above observations in the following corollary. 


Corollary 8.30. Suppose that the polynomial (8.4.8) has a k-fold 
root u and that condition (8.4.12) holds. Then (8.4.1) has k solutions 
yı (n), y2(n), -+3 Yk (n) such that 


y(n) = ntt (1 + o(1))u”. (8.4.16) 


Example 8.31. Investigate the asymptotic behavior of solutions of the 
difference equation 


y(n +3) — (6 +e-"-)y(n + 2) 4 (12 wap) vn Lee ye) 0, 


Solution The characteristic equation is given by A? —6A?+ 12A—8 = 0 with 
roots Ay = Ag = A3 = 2. Also, pi(n) = —e~"~?, po(n) = —1/(n + 1)4, and 
p3(n) = 0 all satisfy condition (8.4.12). Hence, by Corollary 8.30 there are 
three solutions y;(n) = (1 + o(1))2”, yo(n) = n(1 + o(1))2”, and y3(n) = 
n?(1 + o(1))2”. 


Example 8.32. Consider the difference equation 


x(n + 2) + pi(n)a(n + 1) + po(n)a(n) = 0, (8.4.17) 


8.4 High-Order Difference Equations 


where 

pi(n) #0, n>no >O0 
and where 

lim __4pa(n) =p 

n>% pi (n)pi(n — 1) 
exists. Let a(n) be defined by 

Ap2(n) 
a(n) = p. 
m= nT 


Assume that p 4 0, p < 1, and 


Sei 


jJ=no 


Show that (8.4.17) has two solutions, 


)| < œ. 


r4(n)~ (-3) I pi(j) (1 tue (2)) i 
where v = \/1 — p. 
Solution Let 
dE (-3) (ii no) y(n). 


Then (8.4.17) is transformed to 
y(n + 2) — 2y(n+1)+ 


Let 2(n) = (z1(n), z2(n))* = (y(n), y 
into a system of the form 


(p + a(n))y(n) = 0. 
(n+ 1))T. Then (8.4.23) may 


P + D) a ( 0 ) ae 
zo(n + 1) v?—1—a(n) 2} eln) 
Again we let 
zı(n) _ 1 1 u(n) 
z2(n) —(v—1) v+1) \ue(n))- 


(1 =v + (a(n)/2v)) 
—a(n)/2v 
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(8.4.18) 


(8.4.19) 


(8.4.20) 


(8.4.21) 


(8.4.22) 


(8.4.23) 
be put 


(8.4.24) 
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If we let u(n) = (u(n), u2(n))", then we may write (8.4.25) in the form 


u(n + 1) = (D(n) + B(n))u(n), (8.4.26) 
where 
_ (G-v+a(n)/2v) 0 
AS ( 0 (ite E ' 


p 0 a(n)/2v 
RAIS az 0 ) l 


By Theorem 8.23, there are two solutions of (8.4.26) given by 


u(n) ~ i (=v eonen) (o) 


j=no 


u(n) ~ i +v- eonen) B | 


j=no 


These two solutions produce two solutions of (8.4.24), 


1 1 “=i . 1 
w= a (Tu-roa) BL 


1 1 Lt 1 
==) ea (Ila +—owve Gi 


Hence 
vel) ~ TE G- r+ (als)/2»)), 
y(n) ~ JI +v- a02). 
Using (8.4.22) we obtain 
z~ (-3) Mao [a-re (842 
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Similarly, one may show that 


(See Exercises 8.4, Problem 11.) 


Exercises 8.4 


In Problems 1 through 4 find an asymptotic estimate of a fundamental set 
of solutions of the given equation y(n + 1) = [A + B(n)]y(n). 


a= fa s) Be i ae 
ware ON” 


-1 0 0 sinn 0 0 
3. A=10 1 0], Br)=|mrn 
0 0 4 = 1 
0 e UD 
E 0 (0.2) o 
4 A=|4 5 2|, Bmy={[OUD" 0 e” 
2 2 2 0 0 


n2+1 


In Problems 5 through 10 investigate the asymptotic behavior of solutions 
of the given equation. 


5. y(n +2) — (5 e"yin+1)+ (6 ( 1) (n)=0 

6. y(n +2) — (4+ ne™”)y(n) = 0. 

7. y(n +2) + (44+ ne-")y(n) = 0. 

8. y(n + 3) — y(n + 2) + (11 + (sinn)e~") y(n + 1) — 6y(n) = 0 
9. y(n +3) — (3 +27" )y(n + 2) +3y(n + 1) — y(n) = 

10. y(n + 3) — 15y(n + 2) + 75y(n + 1) — (125 + (0.1)") y(n) = 0. 


11. Complete the proof of Example 8.32 by verifying formula (8.4.28). 
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*12. 


13. 


14. 


*15. 


*16. 
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Consider the second-order difference equation 
x(n + 2) + pi(n)a(n + 1) + po(n)a(n) = 0. (8.4.29) 
Assume that p(n) #0 for n > no and that: 
(i) limno 4pa(n)/(pi(m)pi(n — 1)) = p, 
(ii) Dan la(n)| < 00, where 
a(n) = [4p2(m)/(p1(m)pi(n — 1)] — p). (8.4.30) 
If p is neither 0 nor 1, show that (8.4.29) has two solutions 


a) (i) (TI nw) asn, a>), 


where v = y1 — p. 


In Problem 12, suppose that p = 1 and that all the assumptions 
there hold except that the condition ~*~ |a(n)| < œ is replaced 


by D2 mla(n)| < o. 
Show that there are two solutions x(n) ~ (—4)” ae pi(j) and 
zaln) ~n (—$3)" [jong P10) n > 00. 

Consider the difference equation (8.4.29) such that pı(n) 4 0 for n > 
no. Assume that limyp+oo(pe(n))/(pi(n)pi(n — 1)) = 0 and a(n) = 


(po(n))/(pi(m)pi(n — 1)). 


(a) Use the transformation x(n) = (-4)" if eases pil(j)z 
form (8.4.29) to z(n + 2) — 2z(n+1)+a 


n=no 


(b) Show that (8.4.29) has two solutions zı(n) ~ (—1)” IE, pi(j) 
and x(n) = o(v"|a1(n)|) for any v withO<v <1. 

Consider the difference (8.4.17) with conditions (8.4.17) and (8.4.18) 

satisfied. If p is real and p > 1, show that formula (8.4.21) remains 

valid if we assume that 


Co 


XC jla) < œ. (8.4.31) 


J=Nno 


Show that formula (8.4.21) remains valid if one replaces hypothesis 
(8.4.20) by 


X laa)? < œ (8.4.32) 


j=no 


for some real number o with 1 < ø < 2. 
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*17. Show that the conclusions of Problem 16 remain valid if condition 
(8.4.32) is replaced by 


CO 
Seger? 
J=no 


for some real numbers ø and 7 such that 1 < o < 2 and T >Ø. 


8.5 Second-Order Difference Equations 


The asymptotics of second-order difference equations play a central role in 
many branches of pure and applied mathematics such as continued frac- 
tions, special functions, orthogonal polynomials, and combinatorics. In this 
section we will utilize the special characteristics of second-order equations 
to obtain a deeper understanding of the asymptotics of their solutions. 
Consider the difference equation 

x(n +2) + pi(n)x(n + 1) + po(n)a(n) = 0. (8.5.1) 


One of the most effective techniques to study (8.5.1) is to make the 
change of variables 


vn)=(-5) [Hao] um. (8.5.2) 
Then (8.5.1) is transformed to 


y(n + 2) — 2y(n+ 1) 4 


y(n) = 0. (8.5.3) 


Put 


=i 4p2(n) __ 4pa(n) 
q= lim , a(n) = 
n> pi(n)pi(n — 1) pi(n)pi(n — 1) 
Then the characteristic roots associated with (8.5.3) are à = 1— /I— q 
and A2 =14+/1—4¢. 


Here there are several cases to consider: 


q. (8.5.4) 


Case I. If —oo < q < 1, then A; and Az are real distinct roots with 
|Ai| 4 |Ag|. Case I may be divided into subcases. 


(a) If a(n) > 0, then by invoking the Poincaré-Perron theorem we obtain 
two linearly independent solutions y;(m) and y(n) such that 


fi OP ED 
n— o0 yi(n) n—-co yaln) 


Although this does not provide us with explicit representations of the 
solutions yı(n) and yo(n) it does guarantee the existence of a special 


= do. (8.5.5) 
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solution, called a minimal solution. As we will see later, minimal solu- 
tions play a central role in the convergence of continued fractions and 
the asymptotics of orthogonal polynomials. 


Definition 8.33. A solution y(n) of (8.5.1) is said to be minimal 
(subdominant, recessive) if 


wm Yh) 
a a(n) . 


for any solution x(n) of (8.5.1) that is not a multiple of y(n). A non- 
minimal solution is called dominant. One may show that a minimal 
solution is unique up to multiplicity (Exercises 8.5, Problem 1). 


Returning to (8.5.3), let us assume that |1| < |A2|. Then there exist 
Hı, u2 such that |Ai] < pi < u2 < |Ag|. By (8.5.5) it follows that, for 
sufficiently large n, 
lyi(n + 1)| 
lyı(n)| 


ly2(n + 1)| 


<p, and 
ly2(n)| 


> H2. 
Hence 


lyi(m)| < wi lyi(0)|, ly2(n)| > u2ly2(0)|, 
which implies that 


vy l y, ( 2)" Ol 
ae et tim (2) ma S eee) 


Therefore, yı(n) is a minimal solution of (8.5.3) (Why?) (Exercises 
8.5, Problem 1). 


(b) If a(n) € I (Z+), that is, S~|a(n)| < œ, then by Corollary 8.27, 
no 
(8.5.3) has a fundamental set of solutions yı(n) and y(n) such that 


y(n) = AVA +0(1)), yam) = à2 (1 + o(1)). 


Hence 


Notice that we have treated this case thoroughly in Example 8.32, 
where we obtained formulas (8.4.27) and (8.4.28). 
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(c) Suppose that a(n) € (Zt), that is, Xp a*(n) < oo. Then using 
the scheme of Example 8.32, Elaydi [38] showed that (8.5.1) has two 
linearly independent solutions zı (n), 72(n) obeying formulas (8.4.27) 
and (8.4.28). In other words, 


no) =(-3) (Ta) T 0-r+ eo/a +0), 


j=no j=no 


(8.5.7) 


a) =(-3) (Hao) T 0+- e020 + ott. 


j=no J=no 


(8.5.8) 


Moreover, xı(n) is a minimal solution, and x2(n) is a dominant 
solution. 


We remark here that the above results may be extended to systems as 
well as to higher-order difference equations [38]. 


Case IT. If q = 1, then A; = Ag = 1. In this case we use Coffman’s result 
(Theorem 8.29) to produce two solutions of (8.5.3), 


yi(n)~1 and y(n) ~n, 


provided that DS nja(n)| < œ. 


no 


Case III. If q > 1, then \; and àz are complex conjugates \y = A2, 
|A,| = |A2|. In this case we use another result from [43]. 


Theorem 8.34 [43]. Suppose that q > 1 and the following condition 
holds. 


Co 


XO la(n +1) —a(n)| < co. 


n=no 


Then (8.5.3) has two solutions yı (n), yo(n) with 


yi(n) = (1 + o(1)) Ul bilm), i=1,2,..., (8.5.9) 


M=no 


where 


Biıln)=1-—-y1-q+aln), Ba(n)=1+vy1-q+aln), 


provided that Re,/1—q-+ a(n) is semidefinite for a fixed branch of the 
square root (0 < arg yz < 7). 
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8.5.1 A Generalization of the Poincaré—Perron Theorem 


[57] In many applications related to (8.5.1) the coefficients pı (n) and p2(n) 
are of the form 


pi(n) ~an%, po(n)~bn®, ab¥#0, a,Greal; n—> o. 


The asymptotics of the solutions of (8.5.1) can be determined by means 
of the Newton—Puiseux diagram formed with the points Po(0,0), Pi(1,@), 
P2(2, 3) (Figure 8.1) 


Theorem 8.35 [114], [82]. 


(a) If the point P) is above the line PoP (i.e., a > 3/2), then (8.5.1) has 
a fundamental set of solutions x(n) and x(n) such that 


lim aa(n+ 1) 1) = =? 6-2), 


n>œ X(N) a 


(8.5.10) 


Moreover, x(n) is a minimal solution. 


(b) Suppose that the points Po, Pı, Pz are collinear (i.e., a = 3/2). Let 
Ai, Az be the roots of the equation \?+a\+b = 0, such that |A| > [Ao]. 
Then (8.5.1) has a fundamental set of solutions x(n) and x(n) with 


lim aes) ed) 


= Qa 
oy ae A 


lim ine, (8.5.11) 
n> 


provided that |A1| Æ |A2|. Moreover, x2(n) is a minimal solution. 


Tf [Ai] = [A2], then 


a(n)|]1/" 
din sup [EOL] = a eee 


for all nontrivial solutions x(n) of (8.5.1). 


(c) If the point P, lies below the line segment PoP2, then 


(8.5.13) 


Iz(n)| J” -A 


Jim sup Fae 


for all nontrivial solutions of (8.5.1). 


PROOF. Let pi(n) = an® + y(n), Po(n) = bn? + u(n), where v(n) and 
u(n) are null sequences. Then we may write (8.5.1) as 


z(n+2)4+ (a n*+v(n)) a(n+1)+ (bn? + w(n)) x(n) =0. (8.5.14) 
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pB /2 B 
P 
°0 1 2 


FIGURE 8.1. Newton—Puiseux diagram for (8.5.14). 


Making the change of variable x(n) = (n!)°y(n) in (8.5.14) yields 


y(n +2) + LESI ol] baal 
7 er t ae | un) =o. (8.5.15) 


(a) If 2a > $, the characteristic equation of (8.5.14) is A? + aA = 0. The 


first solution zı (n) in (8.5.1) corresponds to A; = —a in the Poincaré- 
Perron theorem. The second solution x2(n) may be obtained by using 
formula (2.2.18) and is left to the reader as Exercises 8.5, Problem 2. 


The proofs of parts (b) and (c) are left to the reader as Problem 2. 


Remark: The above theorem is valid for kth-order scalar difference 


equations. The interested reader may consult [113], [82], [146]. 


Exercises 8.5 


1. Consider a k&th-order scalar difference equation of Poincaré type (8.2.7) 


such that its characteristic roots have distinct moduli. 


(a) Show that the equation has a minimal solution. 


(b) Show that the minimal solution is unique up to multiplicity. 


2. Complete the proofs of parts (a), (b), (c) in Theorem 8.35. 


3. Investigate the asymptotic behavior of the equation 


y(n + 2) — 2y(n +1) + (1 — =) y(n) = 0. 


4. Investigate the asymptotic behavior of solutions of the equation 


Ayin) = y(n +1) 


where a > 1. 


5. Investigate the asymptotic behavior of solutions of 


A2y(n) = yin +1), 
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where a > 1, and 


for all n > 1. 


. Show that the difference equation 


A?x(n) = p(n)e(n +1) 


has two linearly independent solutions x(n) and x(n) such that 


x(n) r2(n) 
as Aa (n) Axe(n) | wor 


. (Multiple Summation). Show that for any sequence f(n), n € Z+, 


n—-1 r-l n—1 


T=no j=no j=no 


. Consider the second-order difference equation [34], [35] 


A? y(n) + p(n)y(n) = 0 (8.5.17) 
such that 
> JIP(I)| < o. (8.5.18) 


Show that (8.5.17) has two solutions yı(n) ~ 1 and y2(n) ~ n as n > 
oo, without using Coffman’s theorem (Theorem 8.29). You may use the 


following steps: 


n-1 


FIGURE 8.2. 


YY MS IW = MDs. (8.5.16) 


*9, 


*10. 
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(a) Use A?y(n) = —p(n)y(n) to show that 
n—-1lr-1 


y(n) = 1 + eln) -E EWO): 


r=1 j=1 


(b) Use formula (8.5.16) to show that 
ly(n)| 


n 


n—1 


< lal+ lel+ slo) 


j=1 


(c) Use the discrete Gronwall’s inequality (Lemma 4.32) to show that 


ly(m)| < can. 
(d) Substitute back into 
n—1 
Ay(n) =c -X pO) 
j=l 


to obtain 


(Generalized Gronwall’s Inequality). Suppose that 


u(n) < a+b Ss cfu"), 


J=Nno 


where 1 Æ y > 0, a > 0, b > 0, c(j) > 0, and u(y) > 0, for j > no. 


Prove that 
TE 1/(1-7) 
u(n) < |a + 011-7) X es) ; (8.5.19) 
j=no 
provided that, for y > 1, 
a!~7 + b(1 — 7) 5 c(j)>0 for n> no. 
j=no 


Generalize the result of Problem 8 to the so-called Emden—Fowler 
equation 


A*y(n) + p(n)ly(n)|7 sgn y(n) = 0, (8.5.20) 
where y # 1 is a positive real number, and 


ie 1 if y(n) > 0, 
a EE E 
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Show that if 


X Ppl) = M < o, 


jJ=no 


then each solution y(n) with the initial condition y(no) with 


[avon + e — Ay(no) En 2(1—7)M >0 


is such that y(n) ~ n as n —> oo. You may use the following steps. 


(a) Let A(n) = Ay(n), B(n) = y(n) — nAy(n). Show that y(n) = 
nA(n) + B(n). 


(b) Show that 
AA(n) = p(n)[|nA(n) + B(n)|]” sgn y(n), 
AB(n) = (n + 1)p(n)[[nA(n) + B(n)|]” sgn y(n). 


(c) Use the antidifference operator A~! to obtain A(n) and B(n) and 
then use the generalized Gronwall’s inequality. 


(d 


WN 


Suppose that xı(n) and x(n) are two linearly independent 
solutions of the equation 


A? x(n) = p(n)a(n +1). 
In addition, assume that for a sequence g(n) we have 
do la) |u(i) = M < o9, 
j=no 
where for a specific m € Z+, 
u(n) = max {|x (n + D|lar(n)P"**, jrin + Dlje), 
|Jz2(n + Dlje), |z2(n + 1)lle2(n) t}. 
Show that there exist solutions y(n) of the equation 
A*y(n) = p(n)yln + 1) + g(n)y”™ t (n) 
such that 
y(n) = a(n)ai(n) + 6(n)z2(n), 
with 
lim a(n)=a, lim (n) = b, 


n— o0 n— oo 


for some constants a, b. 
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8.6 Birkhoff’s Theorem 


Consider again the second-order difference equation 
x(n +2) + pr(n)e(n + 1) +p2(n)e(n) = 0, (8.6.1) 


where pı(n) and p2(n) have asymptotic expansions of the form 


pi(n)~ S75, pan) ~ Ds, (8.6.2) 
j=0 j=0 


The characteristic equation associated with (8.6.1) is A? + aoà + bo = 0 
with roots 


1, A2 = -Žao T qu bo. (8.6.3) 
Extensive work by Birkhoff [11], [12] Birkhoff and Trjitzinsky [13], and 
Adams [2] has been done concerning the asymptotics of equations of type 
(8.6.1) with expansions (8.6.2). Due to the limitations imposed by the intro- 
ductory nature of this book, we will restrict our exposition to second-order 
difference equations. Our presentation here follows closely the excellent 
papers by Wong and Li [147], [148]. 


Theorem 8.36 (Birkhoff—Adams). 


(a) If ài Æ a, ie., aj #4bo, then equation (8.6.1) has two linearly inde- 
pendent solutions x1(n),x%2(n), which will be called normal solutions, 
of the form 


, oS ci(r) 2 
4 ~N Nypi 5 = 1,2, 5 A 
x(n) ~ Apn > oe i (8.6.4) 
aià; + by . 
4S a T = 1, 2, oe 

E aor; + 2bo i (8 € 5) 

s—1 : we — j s a; — j 
SG $ AAO ape bsy (8.6.6) 

rar s—j A 


cilj) =0, ¢(0) = 1. 
In particular, we obtain 


a(l) = —2A7a; (ai — 1) — À; (a2 + Air + ailai — 1)ao/2) — be 
f 2A? (a; = 1) + Aila + (Ài = 1)ao) + by 
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(b) If A, = Az =X but A = —4apo is not a root of the equation aj\+b; = 0 
(i.e., 2b, Æ aga,), then equation (8.6.1) has two linearly independent 


solutions: x1(n), xə(n), which will be called subnormal solutions, of the 
form 


a(n) ~ A2e%i Vne aU) giao (8.6.7) 
ni2 
j=0 
where 
1 by aga, — 2b; aga, — 2b; 
= —-+— =24/ =-24/ 8.6.8 
a 4 ga 2b ’ Yı 2bo , V2 2bo , ( ) 
1 
co = 1, ci(1) = 24b; (aĝa? — 24aoa1bo T. 8aoa1b1 
oY 


— 24agazbo — 9bZ — 32b? + 24bobı + 48bb2). 


(8.6.9) 


(The general recursive formula for c;(n) is too complicated to be 
included here. The interested reader is referred to Wong and Li (147].) 
(c) If Ay = A2 = à and 2b; = agay, then we consider the equation 


a(a — 1)? + (aya + a2)À + b2 = 0. 


Let a1, a2 (Reap > Rea) be the roots of this equation. Then there 
are three subcases to contemplate 


(c1) If a2 -—-a F 0, , then equation (8.6.1) has two linearly 
independent solutions of the form 


_ (8.6.10) 


(co) If ag — a, = 1,2,..., then equation (8.6.1) has two solutions, x(n) 
given by (8.6.10) and x2(n) = z(n)+c(In n)xı(n), where c is a constant 
that may be zero, and 


Co 


d 
z(n) ~ An? ) a (8.6.11) 
n 
s=0 


(c3) If ag = a4, then equation (8.6.1) has two solutions: x(n) given by 
(8.6.10), and x2(n) = z(n) + c(Inn)ai(n), c#0 


z(n) ~ A”n— H (8.6.12) 


where r is an integer > 3. 
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Proof. The main idea of the proof is to substitute the formal solu- 
tions (8.6.4) and (8.6.7) back into (8.6.1) and then compare coefficients 
of powers of n in the resulting expression. Details of the proof will not be 
included here, and we refer the interested reader to the paper of Wong and 
Li [147]. 


Example 8.37. The Apéry Sequence 


w 


satisfies the second-order difference equation 


(n+ 2)?u(n+ 2) — (34n? + 153n? +231n+117)u(n+1)+(n+1)u(n) = 0. 


The sequence [141] 


(8.6.13) 
Writing (8.6.13) in the form (8.6.1), we have 
— (34n? + 153n? + 231n + 117) 
pi(n) = 3 
(n+ 2) 
ay ag 
AO ee tag ht 8 (8.6.14) 
+1\° bi b 
min) = (2 ) =bbt—+— St. (8.6.15) 
n+2 n n 


To find ao we just take the limit of both sides of (8.6.14) to obtain ag = —34. 
Subtracting ao from both sides, multiplying by n, and then taking the limit 
as n — co yields a, = 51. Repeating this process, we obtain ag = —129. 
Similarly, one may obtain bo = 1, bı = —3, bo = 9. Hence by formula (8.6.3) 
the characteristic roots are 41, Ag = 17 + 12V2. From formula (8.6.5) we 
have 


= 51(17+12V2)-3 — -3 
AS (=34)\(17 + 12V2) 42-2” 
= b1(17-12V2)-3 -3 
se CA ee ae 


Hence we have two solutions u(n) and ug(n) such that 


u(n) ~ (17 + 12V2)"n-3/? h eh a) rat | 


n 2 


with c,(1) ~ —15.43155325, and 


wtr) ~ (7 123)? i SU) SED), 


T 
n2 


with c2(1) ~ —1.068446129. Since ug(n) — 0, it follows that u(n) = cu (n) 
for some constant c. 
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Example 8.38. Laguerre Polynomials [147] 


Laguerre polynomials LÊ (x) are defined for 8 > —1,0 < x < œ, by the 
following formula, called Rodrigues’ formula: 


It can be shown (see Appendix F) that LÊ(x) satisfies a second-order 
difference equation of the form 


ny(n) + (x — 2n — 8 + l)y(n—1) + (n+ B—1)y(n — 2) = 0. 


Writing this equation in the form (8.6.1) yields 


xr—2n-ß-3 
n+2 


n+ B+1 


2 
et a) n+2 


y(n+1)+ y(n) = 0. (8.6.16) 


Following the procedure in the preceding example, we obtain 


ee Oa = 2(x-ß+1) 
n n? 
B-1 286-1), 


T 
n n2 


ere eet ts 


The characteristic equation is à? — 2A + 1 = 0, which has a multiple root 
Ai = Aq = 1. This root does not satisfy (x —a+1)A+a—1= 0, and hence 
we have two subnormal solutions of the form (8.6.7). Using formula (8.6.8) 
we obtain a = $, 8 — 4, yı = 2V2i, y2 = —2\/zi. Hence it follows from 
formula (8.6.7) that we have two solutions 


+12. nei 
yp (n) = eV 2v nei 7 8/2— e 1,2, (8.6.17) 


with cı(0) = c2(0) = 1, 


a(t) = (4r? — 126? — 2406 — 24r +3), r=1,2. 
T 


Thus y2(n) = yı(n). But we know from [98, p. 245] that 
LE(x) = n7t 2e?/2g78/271/4p8/2=1/4 cos (2v7 — A — i) 
7 2 4 


+ O(n8/2-3/4)_ 
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Thus 


1 : . 
L(x) = E Ve aa CA r: elPr/2tn diy (n)} 


1 1 \ Š A(x) 
_ 1/2 "/2,,-B/2-1/4, 8/2-1/4 s 
E n feos (2v zÊT 77) >, neZ 
, 1 1 \QB,(2) 
+ sin (2v7 — 36T- 77) >, 73/2 ; 


where Ao(x) = 1, Aı (x) = 0, Bo(x) = 0, and 


(4r? — 128? — 2478 — 24x + 3). 
Remark: In [148] the authors extended their analysis to equations of the 
form 
x(n +2) +n”pi(n)e(n + 1) + n*po(n)x(n) = 0, 
with r and s integers and pı(n), po(n) of the form (8.6.2). 
Exercises 8.6 


1. (Binomial Sums) 


n 


(a) Verify that the sequence u(n) = 779 ( is satisfies the equation 


(n+ 2)?u(n +2) — (Tn? + 21n + 16)u(n + 1) — 8(n + 1)?u(n) = 0. 
(b) Find an asymptotic representation of u(n). 


n 


2. (a) Verify that the sequence u(n) = Xpo ( a satisfies the equation 


(n + 2)?u(n + 2) — 12 (n+5) G + 3n4 x) a(n +1) 
- 64 (n+ 3) (n +1) (n+) un) =o. 


(b) Find an asymptotic representation of u(n). 


3. Find asymptotic representations for the solutions of the equation 
(n +2)?u(n + 2) — ((n+ 2)? + (n+ 1)°)u(n +1) + (n + 1)°u(n) =0. 


4. Find asymptotic representations for the solutions of the difference 
equation 


u(n + 2) — u(n + 1) — (n+ 1)u(n) = 0. 
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5. Find asymptotic representations for the solutions of the difference 
equation 
(n+ 1)(n+4+ 2)a(n + 2) — (n+ 1)[(Qn4+64+c4+1) 42] 
x a(n+1)+n+b)(n4+c)a(n)=0, z#0. 


6. Find asymptotic representations for the solutions of the second-order 
difference equation 


(n+1)(n+2)y(n+2) —(n+1)(2n4+2b+4 L)y(nt+1)+(n+b)?y(n) = 0. 


8.7 Nonlinear Difference Equations 


In this section we consider the nonlinearly perturbed system 


y(n +1) = A(n)y(n) + f(r, y(n) (8.7.1) 
along with the associated unperturbed system 
x(n +1) = A(n)ax(n), (8.7.2) 


where A(n) is an invertible k x k matrix function on Zt and f(n,y) is 
a function from Z*+ x R* — R* that is continuous in y. Let ®(n) be the 
fundamental matrix of system (8.7.2). The first step in our analysis is to 
extend the variation of constants formula (Theorem 8.19) to system (8.7.1). 
Since A(n) is not assumed here to be a diagonal matrix, we need to replace 
Definition 8.17 by a more general definition of dichotomy. 


Definition 8.39. System (8.7.2) is said to possess an ordinary dichotomy 
if there exists a projection matrix P and a positive constant M such that 


|&(n)P&-'(m)| <M, for no <m<n, 
|®(n)(I — P)®~"(m)| < M, for no <n<m. (8.7.3) 


Notice that if A(n) = diag(A1(n),...,Ax%()), then this definition reduces 
to Definition 8.17 if we let (n) = ®(n)P and a(n) = ®(n)(I — P). 


Theorem 8.40 [44], [121], [131]. Suppose that system (8.7.2) possesses 
an ordinary dichotomy. If, in addition, 


2, IF(G,0)| < œœ (8.7.4) 
and 
|f(n, x) — f(n, y)| < y(n)|2 — yl, (8.7.5) 


where y(n) € I*([no,00)) ie, 9, 1G) < œ, then for each bounded 
solution x(n) of (8.7.2) there corresponds a bounded solution y(n) of (8.7.1) 
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and vice versa. Furthermore, y(n) is given by the formula 


y(n) = a(n) + E ®(n) POG +) /G.vG) 
=S SN - PONG + FG. ¥0), (8.7.6) 


ProoF. The proof mimics that of Theorem 8.19 with some obvious mod- 
ifications. Let a(n) be a bounded solution of (8.7.2). Define a sequence 
{yi(n)} (i = 1,2,...) successively by letting y1(n) = a(n) and 
n—-1 
yis(n) = a(n) + X O(n) PO" 5 + YFG, wld) 


-— 2 (n) (I — P)E Hj + 1) FG, ui(9))- (8.7.7) 


We use mathematical induction to show that y;(n) is bounded on [ng, co) 
for each i. First we notice that by assumption, |yi(n)| < cı. Now suppose 


that |y;(n)| < ci. Then it follows from (8.7.4), (8.7.5), and (8.7.7) that 
lyizi(n)| < c1 + M SP bt jul) + FG, 9] 
J=no 
<a +M | So ay) +M] =e, 
J=no 
where 
d= |fG,0)| = M 
J=Nno 


Hence y;(n) is bounded for each i. 
As in the proof of Theorem 8.19, one may show that the sequence {y;(7) } 
converges uniformly on [ng, co) to a bounded solution y(n) of (8.7.1). Con- 
versely, let y(n) be a bounded solution of (8.7.1). Then one may verify 
easily that 
n—-1 ee) 
gln) = X BMP HH) GI- &( G+) LG,90)) 
j=no j=n 
is another bounded solution of (8.7.1). Hence x(n) = y(n) — y(n) is a 
bounded solution of (8.7.2). 


The preceding result does not provide enough information about the 
asymptotic behavior of solutions of system equation (8.7.1). In order to 
obtain such results we need one more assumption on (8.7.2). 
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Theorem 8.41 [44]. Let all the assumptions of Theorem 8.40 hold. If 
®(n)P > 0 as n + œ, then for each bounded solution x(n) of (8.7.2) 
there corresponds a bounded solution y(n) of (8.7.1) such that 


y(n) = x(n) + o(1), (8.7.8) 
y(n) ~ x(n). 


ProoF. The proof is similar to the proof of Theorem 8.20 and is left to 
the reader as Exercises 8.7, Problem 7. 


Example 8.42. Consider the equation 
yi(n + 1) _ (3 0 yi(n) sin y(n) /n? 
R le a) mn 


Here 
oh sin y1 / n? 
e t= (emt) 


Using the Euclidean norm we obtain ei | f(,0)| = 0. Moreover, for 
Tı yı 
T= bs y _ 9 


sin zı — sin yı 


we have 


1 


n2 


[f(n, x) — f(n, y)| = 


COS T2 — COS Y2 


1 
= SV (sina — sin y1)? + (cos £2 — cos y2)?. (8.7.10) 
n 


By the Mean Value Theorem, 
sin x1 — sin yı 
aie =|cosc|, for some c between x, and yi, 
tı- VY 


<1, 
and 
|cos z2 — cos y2| Sg 
|z2 — y2l 
Hence substituting into (8.7.10), we obtain 


1 
|F(n, £) — f(n, y)| < Sle — yl- 
n 
The associated homogeneous equation 


x(n + 1) = A(n)x(n) 
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has a fundamental matrix ®(n) = (o Sa de) and two solutions; one 
bounded, x;(n) = (f) (4)”, and one unbounded, x2(n) = ()3”. If we let 


2 
the projection matrix be 

0 0 

P= ; 

0 1 
P(n)P : l 0 
= > 
The NO ATR) 
as n > oOo. 


Hence all the conditions of Theorem 8.41 hold. Thus corresponding to 
the bounded solution xı (n) = (9) (4)” there corresponds a solution y(n) of 
(8.7.9) such that 


w- OO 


Next we specialize Theorem 8.41 to the following kth-order nonlinear 
equation of Poincaré type: 


y(n + k) + (ay + pi(n)jy(n +k — 1) +--+ + (ae + pa(n))y(n) = f(n, y(n)). 
(8.7.11) 


Corollary 8.43. Suppose that the characteristic equation AF + a,A*~1 + 
--» + ax = 0 has distinct roots 4,1 < i < k, and Y>; |pj(n)| < œ,1 < 
j < k. Assume further that conditions (8.7.4) and (8.7.5) hold. Then for 
each Aj with |A;| < 1 there corresponds a solution y; of (8.7.11) such that 


yj(n) ~ AF. 
ProoF. By Corollary 8.27, the homogeneous part of (8.7.11), 
u(n+k)+ (a1 + pi(n))a(n+k—1)+---+ (ak + pe(n))x(n) = 0, 


has solutions 21(n),v2(n),...,@x(n) with zj(n) ~ AP. If |Aj| < 1, then 
x;(n) is bounded. Corresponding to this bounded solution x;(n) there is a 
solution y;(n) of (8.7.11) with yj;(n) ~ xj(n). Thus yj(n) ~ à}. 


then 


Example 8.44. Investigate the asymptotic behavior of solutions of the 
equation 


=y 


e 


3 1 
2) — = 1)+ -= = —— 8.7.12 
y(n +2)—Sy(n +1) + sum) agy (87419 
Solution The characteristic equation is given by 
3 1 
2 — — — = 
À 5% + 5 0 


with distinct roots 


A, = 1, Ag= =. 
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Now, 

XC f(n,0) = ye < œ. 

n=0 n=0 
Moreover, 

a 1 1 
|f(n,x) — f(n,y)| =e lta? 1} 
-en |z + yl Jesi] 
(1 +z? + y? + x?y?) 


< |z- yl. 
Hence all the assumptions of Corollary 8.43 are satisfied. Consequently, 
(8.7.12) has two solutions y;(n) ~ 1 and y(n) ~ (4)”. 
Exercises 8.7 


In Problems 1 through 3 investigate the asymptotic behavior of solutions 
of the equation y(n + 1) = A(n)y(n) + f(n, y(n)). 


1 

ram=(? 5 |, non = (° oe 
g n+2 
2 3 Es 

2 an= (5 = Fos) = | 


4. Study the asymptotic behavior of solutions of 


y(n + 2) + G + = yn+1)—-A+e)y(n) = 


5. Study the asymptotic behavior of solutions of 
1 
y(n + 2) — 4y(n + 1) + 38y(n) = =—5, n21. 
n+y 
6. Study the asymptotic behavior of solutions of y(n+2)+(1+e~”)y(n) = 
eT 


7. Prove Theorem 8.41. 


In Problems 8 through 10 investigate the asymptotic behavior of the 
difference equation. 
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8. A?y(n) + e~"y3(n) = 0. 


9. A2y(n) — “5 (|y(n)))/? = 0. 
10. A?y(n) + Sun)" =0. 


In Problems 11 and 12 we consider the nonlinear equation 
x(n + 1) = f(x(n)) (8.7.13) 
with f(0) =0, 0 < |f’(0)| < 1, and f’ continuous at 0. 
11. Show that there exist ô > 0 and 0 < a < 1 such that 
le(n)| <a™|2(0)|, neZ*, 
for all solutions x(n) of (8.7.13) with |æ(0)| < ô. 


12. Suppose that f” is bounded near 0, and |f’(ao)| < 1 for |ao| < ô. 
Prove that for any solution x(n) of (8.7.11) with |x(0)| < 6 we have 
x(n) ~ cx(0)(f’(0))” as n — oo, where c depends on x(0). 


13. Use Problem 12 to find an asymptotic representation of solutions of 
the equation 
a(n+1)=a(n)/1+2(n)), x(0) = 0.1. 
14. Find an asymptotic representation of solutions of the equation 
1 

u(n + 1) = u(n) + —. 
u(n) 
8.8 Extensions of the Poincaré and Perron 

Theorems 


8.8.1 An Extension of Perron’s Second Theorem 


Coffman [22] considers the nonlinear system 


y(n + 1) = Cy(n) + f(n, y(n)) (8.8.1) 


where C is a k x k matrix and f : Zt x R® > R* is continuous. The 
following result extends Perron’s Second Theorem to nonlinear systems. 


Theorem 8.45 [22]. Suppose that ae — 0 as (n,y) > (œ,0). If 


y(n) is a solution of (8.8.1) such that y(n) 4 0 for all large n and y(n) > 0 
as n — oo, then 


im yiya] = l:l (8.8.2) 


n— oo 


for some eigenvalue à; of A. Moreover, |A;| < 1. 
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Using the above theorem, Pituk [122] was able to improve Perron’s Sec- 
ond Theorem such that conclusion (8.2.12) is now valid for all nontrivial 
solutions. As a bonus we get a system version of this new result. 

Consider again the perturbed linear system 


y(n + 1) = [A+ B(n)]y(n) (8.8.3) 
such that A is a k x k constant matrix and 


Jim, || B(n)|| = 0. (8.8.4) 
Theorem 8.46 [122]. Under condition (8.8.4), for any solution y(n) of 
(8.8.3), either y(n) = 0 for all large n or 


Jim ylym = al (8.8.5) 


for some eigenvalue r; of A. 


PROOF. Let y(n) be a solution of (8.8.3). Clearly if y(V) = 0 for some N, 
then y(n) = 0 for all n > N. Hence we assume without loss of generality 
that y(n) Æ 0 for n > no. Let Ai, A2,..., Ax be the eigenvalues of A. Let 
p> max |A;| and let 


2(n) =a2(n)/u", n> no. (8.8.6) 
Substituting in (8.8.3) yields z(n + 1) = [4 | LB) z(n) or 
z(n+ 1) = Cz(n) + E(n)z(n) (8.8.7) 


where C = <A, E(n) = +B(n). Notice that the eigenvalues of C are 


ži, HA2 ee Zk, where A;, 1 < i < k, are the eigenvalues of A. Moreover 
Fe < 1, for 1 < i < k. By virtue of (8.8.4), Leal < po'||B(n)|| > 
0 as n — oo. Hence by Corollary 4.34, the zero solution of (8.8.7) is (glob- 
ally) exponentially stable. Thus z(n) — 0 as n > oo for every solution z(n) 
of (8.8.7). By Coffman’s Theorem 8.45 we have limpo */||z(n)|| = “lal; 
for some 1 <i < k. This implies that limp. ¥|ly(n)|| = |Ad|, for some 
1<i<k. 


Now we specialize the preceding result to the scalar difference equation 
of Poincaré type 


a(n+k)+pi(n)c(n+k—1)+---+ pp(n)a(n) = 0. (8.8.8) 


Using the J,,-norm ||y(n)|],.. = max{|x;(n)| | 1 < i < k}, we obtain the 
following extension of Perron’s Second Theorem. 
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Theorem 8.47. Consider the difference equation of Poincaré type (8.8.8). 
If x(n) is a solution, then either x(n) =0 for all large n or 


lim sup 4/|2(n)| = |Ajl, (8.8.9) 
n— o0 


for some characteristic root A; of (8.8.8). ? 3 


PROOF. We first convert (8.8.8) to a system of the form (8.8.3), where 
y(n) = (z(n),z(n + 1),...,a(n + k — 1))T. Notice that |ly(n)|lo = 
max{|z(n)|, |æe(n + 1)|,..., |a(m + k — 1)|}. Conclusion (8.8.9) follows from 
Theorem 8.46. 


Using the lı-norm ||y(n)||ı we obtain the following interesting result. 


Theorem 8.48. [f x(n) is a solution of the difference equation of Poincaré 
type (8.8.8), then either x(n) = 0 for all large n or 


Jim V/|a(n)| + a(n + D| + +--+ |a(n+k— DJ. 


Remarks: 


(i) The conclusion (8.8.9) cannot be improved, the limsup cannot be 
replaced by lim as shown by considering the equation 


x(n + 2)-— a(n) =0. 


This equation = the solution x(n) = 1 + (-1)", where 


limsup,_,0 */|a(n)| = 1 = Ai] = |Ae|. However, limp V/|a(n)| 


does not exist. 


(ii) For a direct proof of Theorem 8.46 without the use of Coffman’s 
Theorem, the reader may consult the paper by Pituk [122]. 


8.8.2 Poincaré’s Theorem Revisited 


The main objective of this subsection is to extend Poincaré’s Theorem 
to systems of the form (8.8.3). So as a by-product we prove Poincaré’s 
Theorem for scalar difference equations. The exposition here is based on a 
recent paper by Abu-Saris, Elaydi, and Jang [1]. The following definitions 
were developed in a seminar at Trinity University led by Ulrich Krause of 
the University of Bremen and the author. 


?This was conjectured by U. Krause and S. Elaydi in a seminar at Trinity 
University. 

3Mihdly Pituk, a Professor of Mathematics at the University of Veszprém, 
received the best paper award (2002) from the International Society of Difference 
Equations for proving Theorem 8.47 and other related results. 
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Definition 8.49. Let y(n) be a solution of (8.8.3). Then y(n) is said to 
be of: 


(1) Weak Poincaré type (WP) if 


Jim, fy] = [AI 


for some eigenvalue A of A. 


(2) Poincaré type (P) if 


for some eigenvalue of A. 


(3) Strong Poincaré type (SP) if 


lim y(n) =C 


n—oo Ar 


for some eigenvalue \ of A and a nonzero vector C. 


(4) Ergodic Poincaré type (EP) if 


im Yl) =v 
nee [lula 


for some eigenvector v of A. 


The following examples [1] illustrate the interrelationship among the 
above concepts. 


Example 8.50. Consider the system 


1 2 
vin =( 1) ao n>0. 


mar (Ja) 


is a solution. Notice that 


Then 


Jim Vlym=1 
but 


lim lyn + DI B/(B+a) ifn is even, 
(B +a)/8 ifn is odd. 


neo |[y(n)| 
Hence y(n) is weak Poincaré but not Poincaré. 
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Example 8.51. Consider the system 


nt 1 0 1 
y(n+1)= 2n y(n), n21, y(1)= . 
0 1 0 
The solution is given by 
LĪ n-iņ 1 
yin) =! = a Pra: 
Notice that limpo At = $, where -4 is an eigenvalue. How- 


ly (n) 


Poincaré but not ergodic Poincaré. 


1 
ever, liMp+oo Ho = limn—œ(—1)”7! (o) does not exist. Thus y(n) is 


Example 8.52. Contemplate the system 


n+1 
yint=[ n fy), n21, THH 
0 1 


The solution is given by 


1 1 
Notice that en = a where o) is an eigenvector that corresponds 


to the eigenvalue 1. However limp—oo uln) diverges. Hence y(n) is ergodic 
Poincaré but not strong Poincaré. 


To facilitate the proof of the main result we present a definition and two 
lemmas. 


Definition 8.53. A solution y(n) = (yi(n), yo(n),..., yi(n))” of (8.8.3) is 
said to have the index for maximum property (IMP) if there exists an index 
r € {1,2,...,&} such that, for sufficiently large n, 


[voy = mex Tym] = lye) 


Observe that solutions in Examples 8.51 and 8.52 possess the IMP, while 
the solution in Example 8.50 does not possess the IMP. 


Lemma 8.54. Suppose that A = diag(A1, A2, . . -, Ax) such that 0 < |Aq| < 
|A2| <-++ < |Ak] and (8.8.4) holds. Then every solution of (8.8.3) possesses 
the IMP. 
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PROOF. Since limno || B(n)|| = 0, for any £ > 0, there exists Ny > 0 
such that ||B(n)|| = maxi<i<z Sean |bij(n)| < £ for n > Ny. We choose 
E > 0 such that 
[A| + € 
Al- E 
Let y(n) be a nontrivial solution of (8.8.3) and let rp be the first index 
such that 


<1 forl<i<j<k. 


lly) = lyr, (7) 


We claim that r, is nondecreasing. To see this suppose that rn41 < Tn, 
then 


lui(n + 1)| < [Allyn] + elyr, (n), 
luin + 1)| > illun) — ely, (n), 
for all n > N,. This implies that 
Iørn (n +11 © [Arnal lyra: (M) + elur, (n) 


lUrnn D] T Arl lyr, (n) = elyr, (n)| 
L rns! Yra (0)|/lyra (n) + E 
[Ar| E 
|Arn+1|| TE <1 
= [Aral =E 


which contradicts the definition of rn+1. Since rn assumes only finitely 
many values, the result follows. 


Lemma 8.55. Let limn-+o0 || B(n)|| = 0. Suppose that A = diag(A1,..., Ax) 
such that 0 < |A| < +++ < |Ak]. Then every nonzero solution y(n) of (8.8.3) 
that has the IMP with ||y(n)|| = |y-(n)| for all large n satisfies 


tim YA)! _ 9 for [Aj # [Arl- 


n> |yr(n)| 


PROOF. Let y(n) be a nonzero solution of (8.8.3) that has the IMP. Since 
limno ||B(n)|| = 0, for any £ > 0 there exists N > 0 such that ||B(n)|| < € 
and ||y(n)|| = [yr (n)| for n > N. We choose e > 0 so that |A;|/(|Aj|—2) < 1 
for 1 <i< j< kand |à;| Æ |A,;|. Observe that, for n > N, 


liln + 1)| < [Aallyi(r)| + ely, (n)l, 
lyi(r + 1)| > [Aillu:(n)| — elo, (mr), 


for 1 < i < k. Suppose that |A;| # |A-|. We first consider the case when 
j >r. Let 


lu;(n)| 


on [ul 
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Then there exists a subsequence n; such that 


lus (ma) _ 
mi> [yr (n:)| 


Observe that 


lmit DIS Al lys) = elur) _ lAl lus (rd) Ayr (ma) | = € 
lyr (m3 T 1)| r. (|Ar| + £)lyr(n:)| |Ar| + € 
for n; > N. Therefore, 


|Agls -€ 
s> 8 
|A;| HE 
and, consequently, 
y E 
s<— ~ 
[Ag] — [Ar] — e 


for all sufficiently small e. This implies that s = 0 and the assertion is 
shown. 
On the other hand, if j < r, then 


lyn D| Ast ysl + ely) _ ( lA; ) ly;(n)| IRE- 
lyr(n +1) = (Ar| — £)lyr(n)| [Ar] —e/ |y¥r(m)| JA- e 
for n > N. Thus 


n—N 
na E lAzl 
a E a OA 
< + = 
ly, (n)| [A |- E€ ly, (N)| ia at |Ar| — € 


and as a result 


ly;(n)| E€ 
lim sup < 
noo |Yr(n)| làr] = [As TE 


for all sufficiently small e. This implies that 


lim sup ly;(n)| = 
noo |Yr(n)| 


and complete the proof. 


By using Lemmas 8.54 and 8.55 we present a sufficient condition for 
which (8.8.3) has the Poincaré property. 


Theorem 8.56. Suppose that the eigenvalues of A have distinct moduli 
and limno ||B(n)|| = 0. Then (8.8.3) possesses the Poincaré property P. 


PROOF. We may assume, without loss of generality, that A is in diagonal 
form, i.e., A = diag(à1, A2,.-., Ap), where 0 < |A] <- < [Ag]. Let y(n) 
be a nontrivial solution of (8.8.3). It follows from Lemma 8.54 that 


ly = ly-(n)| 
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for all large n, for some 1 < r < k. Moreover, Lemma 8.55 implies 
any (vel 

n> | y(n) | 

for 1 < i < k such that i # r. Therefore, if i Ar, then 


unt p, h, ao anm] 
Bano a tLe OG aT | = 9 
and if i = 1, we have 
y(n +1) —Ardr() a Sp fy O _ 
i ln) = 2b ay =o 
Consequently, 
lyn) —Apw(n)l) _ 
me imal 
Since 
+D y y< at-a 
leo A be” 
it follows that 
lyn +D) 
ee e 


The proof is now complete. 


As an immediate consequence of the above result, we obtain the original 
Poincaré’ Theorem. 


PROOF OF THEOREM 8.9. Write equation (8.2.7) as a system of the form 
(8.8.3). Then a solution y(n) of (8.8.3) is of the form y(n) = (x(n), a(n + 
1),...,2(n+k-—1))". By Theorem 8.56 we have 


in WFD 
nso Ty 


for some eigenvalue A. By Lemma 8.54, there exists r € {1,2,...,k} such 
that 


= JA (8.8.10) 


lyn) = [yrn] = a(n +r — 1). 
Substituting (8.8.10) yields 


; |z(n+7)| ; 
lim ——+——— = lim 
n> |a(n+r—1)| n>% a(n) 
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where À is a characteristic root of (8.2.7). Since ae < Te 
limp soo ZZ} exists. Hence limp +. Z8 = A. (See Exercises 8.2, 
Problem 9.) 


Term Projects 8.8 


1. Find the relationships among the notions of WP, P, SP, and EP for 
both scalar equations and systems of Poincaré type. 


2. Find sufficient conditions for EP and SP. 


3. Extend Perron’s First Theorem to systems. 


9 


Applications to Continued Fractions 
and Orthogonal Polynomials 


9.1 Continued Fractions: Fundamental 
Recurrence Formula 


Continued fractions are intimately connected with second-order difference 
equations. Every continued fraction may be associated with a second-order 
difference equation; and conversely, every homogeneous second-order dif- 
ference equation may be derived from some continued fraction. The first 
point of view is useful for computing continued fractions, the second for 
computing the minimal solutions. 

Let {a,}?2, and {bn °°.) be two sequences of real or complex numbers. 
A continued fraction is of the form 


a 
bo + T5 
by + 
f an 
bg + ` + 
bnat ` 
or, in compact form, 
ay a2 a3 
bo + Sb 9.1.1 
o bı + b2 + b3 + ( ) 
or 
bo + K(an/bn) 
or 


bo + K (an/bn). 
397 
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The nth approximant of a continued fraction is defined as 


_ Aln) _ n (a/b, 
tas E a 
idee ee an (9.1.2) 


E TA T 


The sequences A(n) and B(n) are called the nth partial numerator and 
the nth partial denominator of the continued fraction, respectively. It is 
always assumed that s is in reduced form, that is, A(n) and B(n) are 
coprime (i.e., they have no common factors). An alternative way of defining 
a continued fraction is through the use of a “Möbius” transformation, which 


is defined as 


tolu) =bo +u, trhlu)= c De Sy bid (9.1.3) 


Then it is easy to see that the nth approximant is given by 
C(n) = (too t10+-+ 0 tn)(0). (9.1.4) 


Definition 9.1. The continued fraction (9.1.1) is said to converge to a 
finite limit L if limpo C(n) = L, and it is said to diverge otherwise. 


Next we show that both the nth partial numerator A(n) and the 
nth partial denominator B(n) of the continued fraction (9.1.1) satisfy 
a second-order difference equation commonly known in the literature as 
the fundamental recurrence formula for continued fractions. The explicit 
statement of this important result now follows. 


Theorem 9.2. Consider the continued fraction bo) + K&L; (an/bn) with nth 
approximant C(n) = A(n)/B(n). Then A(n) and B(n) satisfy, respectively, 
the difference equations 


A(n) 


Zp AG) ha AAD AD St AWS 


B(n—1) + anB(n — 2), B(—1) =0, B(0) =1. (9.1.5) 


PROOF. The proof of (9.1.5) will be established using mathematical 
induction on n. 


Observe that from (9.1.5) we obtain 


A(1) = bı A(0) a ai A(—1) — by bo + a, 
B(1) = b; B(O) a a, B(-1) = by. 


Hence, (9.1.5) is valid for n = 1. Next, we assume that it is true for n = m, 
that is, 
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Now A(m + 1)/B(m + 1) is obtained from A(m)/B(m) by replacing bm 
by bm + 52+. Then we can write A(m + 1)/B(m + 1) = A*(m)/B*(m), 
where 


A*(m) = (on 4 cat) A(m = 1) + amA(m — 2) 


ox bmp (bm+1 A(m) + Gm41 A(m — 1)). 


Similarly, 
B*(m) = bza (bm4i B(m) + ampı Blm —1)). 


Hence 
A(m+1) bmp Alm) +am+1A(m — 1) 


C(m+1)= B(m+1) bm41 Bm) + m1 B(m — 1)’ 


which establishes (9.1.5), and the proof of the theorem is now com- 
plete. 


The converse of the preceding theorem is also true. In other words, every 
homogeneous second-order difference equation gives rise to an associated 
continued fraction. 

Suppose now we are given the difference equation 


x(n) — byz(n —1)—anz(n—2)=0, an #0 forne Zt. (9.1.6) 


Dividing (9.1.6) by a(n — 1) and then setting y(n) = ® yields y(n) — 


x(n—1) 
an 
bn = y(n—1)* 
Hence, 
an 
n-1l1)= ; 
Applying this formula repeatedly, with n successively increasing, we obtain 
an Qn+1 An+2 
n-l)= ; 
a A ena 


In particular, when n = 1, we have 


x(0) ay, ag a3 
0) = = ; 9.1.7 
ay ee ee ae 
Remark 9.3. We would like to make the following important observations 
concerning (9.1.7): 


(a) Formula (9.1.7) is formal in the sense that it does not tell us whether 
the continued fraction K (an/—bn) converges or diverges. 


(b) Even if the continued fraction K (an/—bn) converges, formula (9.1.7) 
does not show us how to pick the particular solution x(n) for which 
x(0)/x(—1) is the limit of the continued fraction. 
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(c) It is not difficult to show that if K(a,/—b,) converges to x(0)/a(—1), 
then K(an/bn) converges to —x(0)/a(—1). 

A Formula for C(n) 


We end this section by providing a formula for computing the nth 
approximant C(n) = ar of the continued fraction bo + K(an/bn). 


To find the formula, we multiply the first equation in (9.1.5) by B(n—1) 
and the second by A(n — 1) and then subtract one from the other. This 
yields 


A(n)B(n—1)— B(n) A(n—1) = —a,[A(n—- 1) B(n—- 2) — B(n—-1) A(n—2)], 


which is equivalent to 
u(n) = —anu(n — 1), u(0) =—-1, 
where u(n) = A(n)B(n — 1) — B(n)A(n — 1). Hence, 
u(n) = A(n)B(n — 1) — B(n)A(n — 1) = (—1)” aiaz -an, n21. 


(9.1.8) 
Dividing both sides by B(n)B(n — yields 
n— 1) 1)"*1 aya + an 
A iJi: 
a(g B(n—1 ) =E B(n—1)B(n) mene) 


Taking the antidifference A~! of both sides of (9.1.9), we obtain (see 
formula (2.1.16)) 


A(n—1) — A(O) 5 (—1)**4ay09--- ay 


OL ea me B(k—1)B(k) 


This produces the desired formula 


2 (—1)¥ taaz- -a 
Cn)=b0+>), Bk — DBE) i 


k=1 


(9.1.10) 


9.2 Convergence of Continued Fractions 


Two continued fractions K(a,/b,) and K(a*/b*) are said to be equiva- 
lent, denoted by the symbol K(an/bn) ~ K(až /bž), if they have the same 
sequence of approximants. 

Let {dn}; be any sequence of nonzero complex numbers. Then the 
Möbius transformation t,(u) = jh; can be represented as tn(u) = 
ree TE which may be repeated as a composition of two transformations 
tn = Sn © Tn, Where 


Snlu) = ——— and r,(u) = dnu. 
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Hence we have 
ti Otg O+++ Otn = 81071 082020: O 8, OTH 
= sı 0(11 0 82) 0 (r20 $3) O+++ 0 (Tn_-1 O Sn) OT n- 
Define ty (u) := Tn-1 © Sn(u) = deai fata, Then if do := 1, 
C(n) = (t1 0 tg 0-++ otn)(0) = (tī o t30- o 7) (0). 


This yields the important equivalence relation 


K (an/bn) = K (Sete ) (9.2.1) 


which holds for any arbitrary sequence of nonzero complex numbers dọ = 1, 
dy, do,.... 

Observe that if we choose the sequence {dn} such that dnbn = 1, then 
(9.2.1) becomes 


bn— bn n 
K(an/bn) = K (+=) ; (9.2.2) 
Similarly, one can show that 
K(an/bn) ~ K(1/bndn), (9.2.3) 
where d = me dn = aot Hence 


4143 °° * @2n—1 a2a4°** A2n 


dən = ———————, donui = ; (9.2.4) 
a2a4°** Gn 4143 °° * @2n+1 
(Exercises 9.1 and 9.2, Problem 8). 
We are now ready to give the first convergence theorem. 
Theorem 9.4. Let b, > 0, n = 1,2,3,.... Then the continued fraction 


K(1/bn) is convergent if and only if the infinite series $p] bn is divergent. 


PROOF. From (9.1.10) we have 


K(1/bn) RO an Be DB (9.2.5) 


Hence K(1/bn) converges if and only if the alternating series on the right- 
hand side of (9.2.5) converges. Now the fundamental recurrence formula 
for K(1/b,) is 

B(n) = B(n—2)+b6,B(n—-1), B(0O)=1, B(1)= b. (9.2.6) 
This implies that B(n +1) > B(n— 1), n=1,2,3,..., and, consequently, 
B(n)B(n +1) > B(n —1)B(n), n = 1,2,3,.... Thus ees e 
monotonically decreasing. Hence the series (9.2.5) converges if and only if 


Jim, B(n — 1)B(n) = œ. (9.2.7) 
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Again from (9.2.6) we have B(n) > y = min(1,61), n = 1,2,3,..., and, 
consequently, 
B(n — 1) B(n) = B(n — 2)B(n — 1) + bn B?(n— 1) 
> B(n—2)B(n — 1) + bay? 
> (bı + bo +--+ + bn). 


Thus if }>>°, b; diverges, (9.2.7) holds and K(1/b,) converges. On the other 
hand, we have, from (9.2.6), 


B(n-1)+B(n) = B(n—2)+(1+b,)B(n—1) < (1+6,)[B(n—1)+ B(n—2)]. 
It follows by induction that 
B(n — 1) + B(n) < (1+ b1)(1 + b2) -+ (L + bn) < es that tbn, 


Thus if 5 b, converges to L, then B(n — 1) + B(n) < e”. Therefore, 


n=1 


B(n~ 1)B(n) < 7(B(n — 1) + B(n))? < 


Ale 


Consequently, (9.2.7) does not hold, and hence the continued fraction 
diverges. 


A more general criterion for convergence was given by Pincherle in 
his fundamental work [120] on continued fractions. Consider again the 
difference equation 


a(n) — b,a(n—1)—a,2(n—2)=0, a, 40 forne Zt. (9.2.8) 


Theorem 9.5 (Pincherle). The continued fraction 
a, Q2 a3 


es 9.2.9 
by + bo+ b3+ ( ) 


converges if and only if (9.2.8) has a minimal solution y(n), with y(0) £ 0. 
In case of convergence, moreover, one has 


p(n = 1) _ Qn QAn+1 An+2 
p(n — 2) bnt bnyit Dae 


., n=1,2,3,.... (9.2.10) 


PROOF. 


(a) Assume that the continued fraction (9.2.9) converges. Hence if 
A(n) and B(n) are the the nth partial numerator and nth partial 
denominator of (9.2.9), respectively, then 

_ A(n) 
mtd Bln) 
It follows from Theorem 9.2 that A(n) and B(n) are solutions of (9.2.8) 
with A(—1) = 1, A(0) = 0, and B(-1) = 0, B(0) = 1. 
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We claim that 
p(n) = A(n) — LB(n) (9.2.11) 
is a minimal solution of (9.2.8). 


To prove the claim, let y(n) = aA(n) + 8B(n), for some scalars a and 
B, be any other solution of (9.2.8). Then 


iit E OE a Tig AE 6, 


n>% y(n) neo aA(n)+ BB(n) n>% a (A(n)/B(n)) + B 


This establishes the claim. Furthermore, y(—1) = 1 4 0. 


ae ae 
= 


Conversely, assume that (9.2.8) possesses a minimal solution y(n), 
with y(—1) # 0. From (9.1.7), the associated continued fraction to 
(9.2.8) is K(an/—bn) with the nth approximant C*(n) = a. Since 
A*(n) and B*(n) are two linearly independent solutions of (9.2.8) with 
A*(-1) = 1, A*(0), B*(-1) = 0, B*(0) = 1 (Theorem 9.2), it follows 
that 


p(n) = A*(n) — LB*(n), n> 0. 


Observe that 


Hence 


_ AX(n) _ (0) 
Jim Bn) ~ ol) (9.2.12) 


From Remark 9.3(c), we conclude that 


This proves the first part of the theorem as well as (9.2.10) for n = 1. 
The proof of (9.2.10) for n > 1 is left to the reader as Exercises 9.1 
and 9.2 Problem 5. 


The following example illustrates Theorem 9.5. 


Example 9.6. Contemplate the continued fraction 


aa a 


eee ee 21 
thitik (2:210) 


where a is any complex number. Find conditions on a under which the 
continued fraction converges. 
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Solution 


Method 1: Let A(n) and B(n) be the nth partial numerator and 
denominator, respectively. Then from (9.1.5) we have 

A(n) — A(n—1) —aA(n-—2)=0, A(-1)=1, A(0)=0, 

B(n) — B(n—-1) —aB(n—-2)=0, B(-1)=1, B(0)=1. 


The characteristic equation of either equation is given by A? — \— a = 0, 
whose roots are 


1+VJ/1+4a 
A1,2 = ==? 
Now, if |Ai| Æ |Ag|, then the difference equation 
x(n) — x(n — 1) — ax(n — 2) =0 (9.2.14) 


has a minimal solution and, consequently by Pincherle’s theorem the 
continued fraction (9.2.13) converges. 
Suppose that |A2| < |Ai|. Then y(n) = A} is a minimal solution of 
(9.2.14). Hence by (9.2.12) the continued fraction (9.2.13) converges to 
d2 = —4 + V1 + 4a. 


On the other hand, if a = —4, then \y = A2 = 4. Thus A(n) = e1(4)" + 
con(4)". Using the initial P A(—1)=1, = 0, we get cı = 0, 
C2 = Hence A(n) = nays Similarly, we obtain B(n) = (n+ 


2 = -}. 
1)($)". Thus 


A(n) ee 
K(a/1) = Ba) = 2m =N 


Conclusion. If a is complex, K(a/1) converges to —} + 4/4 +a if and 
only ifa ¢ {x ER: £ < —4 
Method 2: Let 


aaa 
= FIFI 
Then 
£ S 2 7-a=0 
1l+2 
Hence 
= un Eig oal M 
ti = 2 4 a, T2 = 2 4 a, 


are two solutions. If a is real we require that a > —+ in order for x to be 
real. By inspection, we conclude that the continued function converges to 
Tı- 
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Exercises 9.1 and 9.2 


1. Show that 


converges to (1 + v1 — 4a)/2 if 0 < 4a < 1. 
2. Prove that the continued fraction 


1 1 1 


bi+ bet b3+ - 
converges if b; > 1 for i= 1,2,3,.... 
3. Discuss the convergence of the continued fraction 


aaa 


b+ b+ b+ °° 


“9 


where a,b are complex numbers, a Æ 0. 


4. Show that the continued fraction 


is equivalent to 


a(x) a(x) a(x) 
1- 1- {= * 


where ao(x) = we On(2) = manasa? Sle 8 it aoe 


5. Prove (9.2.10) for n > 1. 
6. [19] Prove that if bo + KX; (an/bn) = L #0, then 


ao 
Ke o (an/bn) = =. 
4 (anfbn) = + 
7. Consider the continued fraction bo + K(a,/b,) and let A(n) and B(n) 
be the nth partial numerator and denominator, respectively. 
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Show that 

bo 1 0 
ay bi 1 
0 a b 1 

Any=| 

An-1 baca 1 
0 an bn 
bı 1 0 
ag bg 1 
a3 b3 1 
B(n) = 


8. Prove (9.2.4). 


9. Let {tn} be a sequence of Möbius transformations defined as 


talu) = » Qn 4#0, n=0,1,2,.... 


A(n) + A(n — 1)u 
B(n) + B(n—1)u 


and A(n)B(n—1)— A(n—1)B(n) £0, n = 0,1,2,..., where A(n) and 
B(n) are the nth partial numerator and denominator of bo + K(an/bn), 
respectively. 


10. Let {A(n)} and {B(n)} be sequences of complex numbers such that 
A(—1)=1, A(0)=b, B(-1)=0, B(0)=1, 
and 
A(n)B(n — 1) — A(n — 1)B(n) #0, n=0,1,2,.... 
(a) Show that there exists a uniquely determined continued fraction 


bo + K (an/bn) with nth partial numerator A(n) and nth partial 
denominator B(n). 


9.2 Convergence of Continued Fractions 


(b) Show that 


A(n) B(n — 2) — A(n — 2)B(n) 


bn = ate 1 B(n— 2) — A(n—2)B(n— 1) 


11. Show that the nth partial denominator of the continued fraction 


1 ay (1 = aı)az 


1 
1— 1— 1— 


B(n) = (1 — aı)(1 — a2) -- (1 — an-1), nÈ1. 


12. [19] Let an = (1 — an-1)an, ao = 0, 0 < an < 1, n = 1,2,3,.... 


that the continued fraction 


converges to (1 + L)~!, where 


a (ear ca eae 


407 


Prove 


13. Let Bn = (1 — bn—1)bn, 0 < bo < 1,0 < bn < 1, for n > 1. Prove that 


BL Be Ba 
1—1-1- 
converges to (bo + i), where 


22 bibo +++ bn 
B= . 
2 Ene coe) 
14. Let an > 0, bn > 0, n = 1,2,3,..., and let 


2 Dn bnbn+i 


An+1 


Show that the continued fraction 
a, a2 Q3 


bi + bet bst - 
converges. 
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15. Show that the continued fraction 
1k 9k 3k 


b+ b+ b+" 
converges for k < 2 and diverges for k > 2. 


*16. (Term Project, [31]). Consider the continued fraction 
mnla) =2—-~———.... 


Let tı(a) = 2, to(a) = 2 — a/2, t3(a) = 2 — a/(2 — a/2),... be the 
approximant sequence. 


(a) Show that t,41(a) = 2— -9,, t =2,n=1,2,3,.... 


tn (a)? 
(b) Show that if a < 1, the continued fraction converges to 1+vy1 — a. 


(c) A number a is said to be periodic (of period n) if tp44(a) = ty for 
k=1,2,3,.... 


Show that if a is of period n, then tn-1ı(a) = 0. 


(D Let Pale) = X OF scalps 


greatest integer function. Show that 


k where | | denotes the 


Py42(@) = 2Pa41 (£) — (£ + 1)Pa(x), Pi(x)=1, Po(x) =2. 
(e) Prove that tnla) = Pa+1(a — 1)/Pa (a — 1), n = 1,2,3,.... 


— 
lary 
cy 


Prove that a number a is periodic if and only if (a — 1) is a zero 
of the polynomial P,(2). 


9.3 Continued Fractions and Infinite Series 
Our main objective in this section is to show that every infinite series can be 


represented by a continued fraction and vice versa. Let {cn} be a sequence 
of complex numbers, with cn 40, n=1, 2, 3, ..., and let 


n 
Un = J Ck, n=0,1,2,.... 
k=0 


Let po = Co, P1 = C1; Pn = Cn/Cn—1- Then Co = Po, Cn = P1P2°** Pn- 
Moreover, 


n 
po + >> pip2+++ Pk = po 
k=1 
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Hence 


Co 


X ox = bo + K (an/bn), (9.3.1) 
k=0 


where bp = co, a1 = C1, b1 = 1, and 


Cc. 
an = -——, b, =1+ 2 ; n = 2,3,4,.... 
Cn—1 Cn—1 


To illustrate the above method observe that 


Co 


a Cız Coz/c1 c3z/c2 
CkZ” = Co + oT Toaz 
1-1+ 14 
k=0 cı c2 


Here is a more interesting example. 


Example 9.7. Consider the Riemann zeta function, defined by 


A= r E e kA 


r=1 


Then bo 0, ay 1, bı 1, 
k k 
a=- (=) , and n= 1+ (=) : 
n n 


C(k) = K(an/bn). 
If we let u(n) = K7_,(a;/b;), then it follows from (9.1.6) that 


u(n +2) — (: + (5)} u(h+1)4 (LEY um =0. (9.3.2) 


Thus 


n+2 n+2 
An equivalent representation of ¢(k) may be obtained using (9.3.2): 
((k) = K(1/bndn), 
(2/3)* (4/5)* ---(2n — 2/(2n — 1))* 
(1/2)* 6/9 --(2n—1/(2n))* 
(1/2)* (3/4)* -2n — 1/27) 
(2/3)* (4/5 = n/n +1) 
Example 9.8. (Regular continued fractions) [73]. 


d =1, 2n = 


a 


2n+1 = 


A regular continued fraction bọ + K(1/b,) of a positive real number x is 
defined by letting 


bn = [æn], n=0,1,2,..., 
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where 
1 


me ee = Frac(an—1) 


o o n=1,2,3,..., 
where | | denotes the greatest integer function, and Frac(£n) denotes the 
fractional part of £n. If Frac(£zn-1) = 0, the regular continued fraction 
expansion terminates with bn—1. Suppose now that x = k/l is a rational 
number. 

Set xo = x and rı = l. Then by the Euclidean algorithm, 


To = bo +r2/rı = bo + 1/zı, with m1= rı/r2, T2 < T1, 


r= bı + r3/r2 = bı + 1/x2, with rg = r2/r3, T3 < T2, 


Lm = bm + Tm+i/Tm = bm + 1/am, with Lm = Til Penis Tm+1 <Tm- 


Since {r;} is a decreasing sequence of positive integers, this algorithm 
necessarily terminates; that is, there exists n such that rn+2 = 0; the last 
relation would be £n = bp. 

Let us define the Mobius transformation 


tolu) = bo + u, tml) = m=1,2,...,n. 
Then 
1/£n = tn(0) and 1/£m = tm (1/£m+1), 
m=1,2,...,n—1, zo = to (1/ax1). 
It follows that 
x = (toot; 0---ot,)(0), 
and, consequently, 
E eee N A (9.3.3) 


bit bot `` bn 


The continued fraction (9.3.3) obtained in the above procedure is called 
regular. 


Conclusion. A real number is rational if and only if it is the value of a 
terminating regular continued fraction. One may easily show that 


SO. 1 11 
48 3+ 1+ 2+ 4’ 
12 1 1 1 11 


55 4+1+1+2+2 
Using the same procedure one may find a regular continued fraction rep- 
resentation of irrational numbers. It turns out that every irrational number 
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can be represented by a nonterminating regular continued fraction and, 
conversely, the value of every nonterminating regular continued fraction is 
irrational [73]. For example, 

és (9.3.4) 


l1 1 1 1 1 1 1 1 
7=2 5 
y 1+ 1+ 1+ 4+ 1+ 1+ 1+ 4+ 
1 A he A SP eT 
e=2 ere, (9.3.5) 


14+ 24+ 1414 4414146414148 


Exercises 9.3 


1. Show that: 
1+ v5 1 1 
=14 ak Id io). 
5 ER (golden ratio) 
2. Verify (9.3.4) and (9.3.5). 
3. Show that: 
= a> oa 32 


CE e E 
4. Show that, for —1 < x < 1, 

x lax? 9x? 25x? 

1+ 3—z2+ 5-—3r2?+ 7- 5r?+ 77" 


arctan £ = 


and, consequently, 


m 1 1 9 25 49 
4 14+ 24 24 24 247° 


5. Prove for z Æ 0, 


z lz 2z 3z 
1— 2+z— 34+2- 4+z 
6. Let uo, U1, Ug,... be numbers such that u; Æ 0, i = 1,2,3,..., and 
Un = uo + Uy +--+ Un. Let 


bo = Uo, bi = 1, ay = 4/2, 
Un + Un+1 
bon = 2, bang = ————,,_ n=1,2,..., 
Un 
Un+1 
a2, =l, a,,, =—-—. 
Un 


Show that the (2n)th and (2n + 1)th approximants of bo + K (adn/bn) 


are U,, and U, + =", respectively. 


*7. (Open Problem). It is known [141] that ¢(2) and ¢(3) are irrational 
numbers. Show that ¢(5) is irrational. 


412 9. Applications to Continued Fractions and Orthogonal Polynomials 


In Problems 8 through 11 we will deal with Diophantine equations and 
their generalizations. 


Diophantine Equations. Let k and l be two positive integers that are co- 
prime. The problem that we are interested in is to find all pairs of integers 
(x,y) that solve the equation, called a Diophantine equation, 

ka —ly=1. (9.3.6) 
Let 

k 1 1 1 
Rie T 

If A(n) and B(n) are the nth partial numerator and denominator, 
respectively, then from (9.1.8) we have 


A(m)B(m — 1) — A(m—1)B(m) = (-1)™"', m=1,2,..., n. (9.3.7) 


Moreover, 


k 
o (9.3.8) 
Observe that if m = n, then (9.3.7) becomes 
A(n)B(n — 1) — A(n — 1)B(n) = (-1)""1. (9.3.9) 


A(n) = d-A(n) 
B(n) d-B(n) 


Now, if A(n) and B(n) have a common divisor d, then 


A(n) 
Bon)’ Hence 


A(n)B(n — 1) — A(n — 1) B(n) = (-1)"71. 


But this is impossible, since from (9.3.9) we get 


d? (Any B(n ~1)-A(n- 1) B(n)) = (-1)""), 
Hence it follows from (9.3.8) that A(n) = k and B(n) =1. 
Now, to find a solution of (9.3.6) we consider two cases. 


Case (a). If n is odd, we let x = B(n— 1), y = A(n — 1). Then from (9.3.9) 
we have 


ka — ly = A(n)z — B(n)y = (1)! = 1. 
Case (b). If n is even, we let x =1— B(n — 1), and y = k — A(n — 1). Then 
kz — ly = A(n)(B(n) — B(n — 1)) — B(n)(A(n) — A(n — 1)) 
=—-(-1)"1=1. 
8. Show that the general solution of (9.3.6) is given by 
(x,y) = (z0, yo) + m(I, k), 


where m is an arbitrary integer and (xo, yo) is any special solution. 
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9. Solve the equation 61a — 48y = 1 by finding all pairs of integers (x, y) 
that satisfy it. 
*10. Solve Pell’s equation 
r? — ly = 1, 


where / is an integer, not a perfect square. You need to find all pairs 
of integers (x, y) that solve the equation. 


*11. Solve z? — 7y? = 1. 


9.4 Classical Orthogonal Polynomials 


Let w(x) be a positive function on a given finite or infinite interval (a,b) 
such that it is continuous, except possibly at a finite set of points. Moreover, 
we assume that the “moments” 


b 
Un =| x" w(x) dx (9.4.1) 


exist and are finite. Then a sequence {P,,(a) }°29 of polynomials, P,,(x) of 
degree n, such that 


b 
f Pa(x)Pm(x)w(x) dx = Andnm, n,m=0,1,2..., (9.4.2) 
is said to be orthogonal over (a,b) with a weight function w(x), where 
1, n=m, 
Ônm = 
0, nm, 


is the Kronecker delta function. A polynomial P,,(z) = pa angg" is said 
to be monic if the coefficient ann of the leading term zx” is 1. 


Example 9.9. (The Chebyshev Polynomials Revisited). 


The Chebyshev polynomials of the first and second kind are defined, 
respectively, as follows (See Exercises 2.3, Problem 11): 
Tn(x) = cosnð, Up(x) =sin(n+1)0/sindé, n=0,1,2,... , 


where 0 = cos~! x and |z| < 1. 


Observe that {T,(z)} is orthogonal on the interval (—1,1) with the 
weight function w(x) = (1 — 2?)~2. 
To show this, note that 


1 T 
i Tn(2)Tin(2)(1 — 22)7? ax = f cosnô cos mô d0 =0 ifn#m. 
0 


=i 
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Similarly, we may show that {U,,(x)} is orthogonal on (—1,1) with the 
weight function w(x) = (1 — x?)2. 


Next, we address the question of uniqueness of orthogonal polynomials. 


Theorem 9.10. If the coefficient ann of x” in P,(x) is prescribed for 
each n, then the sequence of orthogonal polynomials relative to a weight 
function w(x) exists and is unique. Moreover, each P,,(x) is orthogonal to 
all polynomials of lower degree. 


Proof. We will use mathematical induction on n to prove the first part. 
Suppose that aoo and a1, are known; Po(a) = aoo and P, (x) = aiiz + ayo. 
Then from (9.4.2), J? w(x) (lavoar + agodio) dx = 0, which gives ajo. 
Assume now that Po(x), Pi(x),...,Pn—1(#) are determined such that they 
satisfy pairwise (9.4.2). 

Then Pa(£) = ann” + bn n—1Pp—1(£) +--+ + bn,oPo(x), where bn,s are 
independent of x. From (9.4.2), we have for r = 0,1,...,n—1, 


b 


b 
ann | w(x)x” P, (x) dx + bon f w(x)(P,(a))? dx = 0. 


Since f? wa) (P,(x))? dx > 0, it follows that bnr exists and is uniquely 
determined for r = 0,1,...,2—1. This establishes the first part. The second 
part is left to the reader as Exercises 9.5, Problem 1. 


We are now ready to present some of the main classical orthogonal 
polynomials. 


1. Jacobi polynomials PLO (a), a > —1, 8 > —1. 
These polynomials are orthogonal on (—1,1) with the weight func- 


2n +a + 
tion w(x) = (1 — x)*(1 + a?, and ann = 27” : An 

n 
explicit expression for the Jacobi polynomials Pho (x) are given by 


Rodrigues’ formula 


n(—a)-*(1+2)- a 


PLP) (a) = (1) C E 


2”n! da” 
(9.4.3) 
To write Pio) (x) more explicitly, we need to utilize Leibniz’s formula 
ae L (n\ d'Eu dtv 


(See Appendix G.) 
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Hence, 
d” nTa n 
a Teg FATE 
=y. o D= (1 — s) tA D (1 + x)" 
k=0 
= (-1)"(1—2)*(1 + x)fn! 
r fn+a\fn+8 he 
ae ( : Je wKe + 
Therefore, 
Q, —n Z n+a n+p n— 


with the leading coefficient 


onon (nta)\ (n+B8\ _ n [20n+a+8 
Ann = 2 ee i )-2 ( : ) (9.4.6) 


(See G.) 


To verify (9.4.3), let Q,(a) denote the right-hand side of the equation 
and let g(a) be another polynomial. Then successive application of 
integration by parts yields 


i. (1—2)"(1— 2)’ Qn(a)g(n) dx 


-1 


: fo a-a targa) dx, (9.4.7) 


~ 2an! zg 
where g™) (x) denotes the nth derivative of g(x). 


Observe that if g(a) is a polynomial of degree less than n, then 
g(x) = 0. Hence, Qn (x) satisfies (9.4.2). Furthermore, the coefficient 


of x” in Q,(2) is 
gn 2n+a+B 


Hence, by uniqueness (Theorem 9.5), Qn(x) = PLO (a). 


. Legendre polynomials P,,(x): These are special Jacobi polynomials 
obtained by letting a = 6 = 0. Hence (9.4.3) is reduced to 


P (2) = POM (a) = EDT P ia _ gary, (9.4.8) 


2n! dx” 
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The Legendre polynomials are orthogonal on (—1,1) with the weight 
function w(x) = 1. Moreover, using Leibniz’s formula yields 


P,(2) = 2" > é " ; 8 (a —1)¥(e+1)"-*,| (9.4.9) 


k=0 


with leading coefficient ann = 2~"(2n)!/(n!)?. 


. Gegenbauer (or ultraspherical) polynomials P¥(x): These are 


special Jacobi polynomials obtained by setting a = @ and a =v — Z, 


The Gegenbauer polynomials are orthogonal on (—1, 1) with the weight 
function w(x) = (1 — x?) 1, v > —4, and ann = In (ET TNs By 
Rodrigues’ formula we have 


v ae i —v d” v+n— 
P (x) — co S x?) (i _ x’) +n—-1/2 


re dx” 
—1 
z 2—1 n+2v—1 PU-1/2¥-1/2)(¢)_ (9.4.10) 
y vy —1/2 


Using Leibniz’s formula yields 


PY (e) =2-" T a Era 
S (" Paa tes ” E E 


(9.4.11) 


. Laguerre polynomials L(x), œ > —1, are orthogonal on (0, 00) with 


the weight function w(x) = e~*x°, and ann = (—1)” /n!. Moreover, 


—gz „n+a 
Ai age (e7a"T®), (9.4.12) 


Dy (a) = 


By Leibniz’s formula we can show that 


£ n Q =p k 
Ea) =, (z ; ( “) . (9.4.13) 


. Hermite polynomials H,,(x) are orthogonal on (—co,0o) with the 


weight function w(x) = e77", and ann = 2”. These are given by 


Rodrigues’ formula 


x2 d” 2 


H,,(e) = (-1)"e"" 7 (e™). (9.4.14) 
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By Taylor’s theorem, 


ecru w? Hy( 
-5 nl 


Expanding e?®” and e-’” as power series in w and taking the Cauchy 


product! of the result gives 


2aw—w? (—1)* (2x) w” 
i T E (n—2k)l kl ` 


Hence, 


2/2] (_4)k(oq)\n—2k 
H,,(x) =n! 3 SE (9.4.15) 


9.5 ‘The Fundamental Recurrence Formula 
for Orthogonal Polynomials 


We now show why difference equations, particularly those of second order, 
are of paramount importance in the study of orthogonal polynomials. The 
following is the main result. 


Theorem 9.11. Any sequence of monic orthogonal polynomials {P,,(x)} 
with Pp(x) = Ypo akt" must satisfy a second-order difference equation of 
the form 


Pa+1(£) — (Anz + By) Pn(x) + CnPn-1(£) = 0 (9.5.1) 
with 
Ae maar (9.5.2) 


PROOF. Choose An such that Pp+1(£) — AngzPp(x) does not possess any 
term in z”+1, Hence, we may write 


Py41(x) — Anz Pa( => dnr P, (£ (9.5.3) 


Multiplying both sides of (9.5.3) by e (x) and integrating from a 
to b yields 


b b 
dns f w(x){P.(x)}? dx = -An | xw(x)P.(x)Pa(x) dz. (9.5.4) 


1Given two series yon n=0 An and X “gon, we put Cr = =Z a o akbn— k= 


0,1,2,.... Then Xo en is called the Cauchy product of the two series. 
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Since xP, (x) is of degree s+1, and P,,(x) is orthogonal to all polynomials 
of degree less than n, it follows that the right-hand side of (9.5.4) vanishes 
except possibly when s = n — 1 and s = n. Hence, dnn and dy n—1 are 
possibly not zero. Therefore, from (9.5.3) we have 


Payı (£) T (Anz Te dnn) Ppa (£) A dn, n—1Pn-1(2) =0, 
which is (9.5.1) with Bn = dnn, Cn = —dn.n—1- 


Remark: 


(i) A monic sequence of orthogonal polynomials {P,,(2)} satisfies the 
difference equation 


Py4i(x) — (£ — Bp) Ên (£) + IrPr_1(x) = 0, (9.5.5) 
where 
By = yy = L, (9.5.6) 
Qn+1,n+1 An—1,n—1 


This may be shown easily if one writes P(x) = az} P, (æ). 

(ii) If Pa(—r) = (—1)” Pa (x), then {P,(x)} is often called symmetric. In 
this case, one may show that Bn = 3, = 0. To show this, let Q,(2) = 
(—1)” Pa(—x). Then 

Qn41(@) + (Bn — An®)Qn(£) + CrQn-1(z) = 0. (9.5.7) 
If Qn(£) = Pa(x), then subtracting (9.5.1) from (9.5.7) yields B, = 0. 


(iii) The converse of Theorem 9.11 also holds and is commonly referred to 
as Favard’s theorem. Basically, this theorem states that any polynomial 
sequence that satisfies a difference equation of the form of (9.5.1) must 
be an orthogonal polynomial sequence. 


Let us illustrate the preceding theorem by an example. 


Example 9.12. Find the difference equation that is satisfied by the 
Legendre polynomials P,,(x). 


Solution From (9.4.8) the coefficients of x”, x"~1, x”~? are, respectively, 
(2n)! (2n — 2)! 
Unn = BT An,n-1 
27 (n!)? ' 2"(n — 2)! (n= 1)! 


Furthermore, {P (x)} is symmetric, since P, (£) = (—1)” Pa (— a): Thus, 
from Remark (ii) above, we have B,, = 0. From (9.5.2), we have Ap, = 


= 0, an,n-2 = 


It remains to find Cn. For this purpose, we compare the coefficients of «”— 
n (9.5.1). This yields 


Qn+1,n—1 — Ann n—2 ga CnQn—1n—1 = 0. 


9.5 The Fundamental Recurrence Formula for Orthogonal Polynomials 419 


Thus, 


Anan, n-2 — Ant+i,n—-1 =n 
Ch = = 


Qn-1,n-1 n+ 1 


Hence the Legendre polynomials satisfy the difference equation 
(n + 1)Pr4i(x) — (2n + 1)a@P,(x) + nPp_-i(x) = 0. (9.5.8) 


Example 9.13. Find the difference equation that is satisfied by the Jacobi 
polynomials PS“ (x). 


Solution This time we will use a special trick! Notice that from (9.4.5) we 
obtain 


PP) (2) = (-1)" PF) (2), (9.5.9) 
Ae e , (9.5.10) 
Peel = eo ' (9.5.11) 


From (9.4.6) and (9.5.2) we get 

(2n +2 +a +p)(2n+1+a+ 2) 
2(n+1)\(n+1+a+ 8) 

Using (9.5.10) and setting z = 1 in (9.5.1) yields 


n+a+1 n+a n+a-—1 
( ee ) (an +B ( sa )+( eet | - (9.5.18) 


Similarly, setting x = 1 in (9.5.1) and using (9.5.11) yields 
n+ 8+1 n+ 
(-1)""? ( : ) T (=A; F Ba )(=1)” ( ’) 


n+1 n 
+ C,(—1)"7} oe) =0. (9.5.14) 


Multiplying (9.5.13) by ("4") and (9.5.14) by ("$®) and adding, produces 
an equation in A, and C, which, by substitution for A, from (9.5.12), 
gives 


An = (9.5.12) 


(n+ a)(n+ B)(2n+2+a+ 8) 


Cn = . 9.5.15 
(n+1)(n+at+6+4+1)(2n+a+ 8) ( ) 
Substituting for C, in (9.5.13) yields 
2 R2 
B = (2n +1 +a + B)(a? — p?) (9.5.16) 


2(nt+ )in+at+6+1)Qn+a+ 6) 
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Exercises 9.4 and 9.5 


i; 


o A WwW N 


*10. 


Let {P,(x)} be a sequence of orthogonal polynomials on the inter- 
val (a,b) relative to the weight function w(x). Prove that P,(x) is 
orthogonal to any polynomial of lower degree. 


. Verify formula (9.4.9). 
. Verify formula (9.4.12). 
. Verify formula (9.4.14). 


. Find the difference equation that represents the Gegenbauer polyno- 


mials {P¥(x)}. 


. Find the difference equation that represents the Laguerre polynomials 


{Ln (2)}. 


. Find the difference equation that represents the Hermite polynomials 


. (Charlier polynomials). Let ce) (x) denote the monic Charlier poly- 


nomials defined by 


(9.5.17) 


Show that {Cc ()} satisfies the difference equation 


CM (2) = (£ -n - a)CM (x) — an, (2), n> 0. 


. (The Bessel function). Let n € Z, z € C. The Bessel function J;,(z) is 


defined by 


Find the corresponding difference equation. 
(Christoffel-Darboux identity). Let {P,(x)} satisfy 
Pa(x) = (£ — cn)Pa-1 (£) — APn—2(), 2 =1,2,3,..., 
P(x) =0, Po(x)=1, AF. (9.5.18) 
Prove that 


eee one 


ax = (MA2 Anp) t 
k+1 


% Pari (2) Pa (u) — Pr(@) Ph+ (u) 


wv U 


(9.5.19) 


9.6 Minimal Solutions, Continued Fractions, and Orthogonal Polynomials 421 


11. (Confluent form of (9.5.19)). Show that 
yo Pra (#)Pn(#) ~ Pa(t)Pnta(2) 
AL j 


A2- Ag+ A1À2 -4 An+1 


12. Consider the sequence {P,(x)} satisfying (9.5.18) and let 
Qn(z) =a" Palax + b), a #0. 


Cn — b 


Qn-1(2) ~ “8 Qn-2(2) 


(b) If {P (x)} is an orthogonal polynomial sequence with respect to 
the moments un, show that {Q,(x)} is an orthogonal polynomial 
sequence with respect to the moments 


meer") eon 


k=0 


(a) Show that Q,(x) = (a — 5 


13. Suppose that {Q,,(z)} satisfies (9.5.18), but with the initial conditions 
Q_1(x) = —1 and Qo(z) = 0. 
(a) Show that Q,(x) is a polynomial of degree n — 1. 
(b) Put PY (x) = A7'Qn4i(x) and write the difference equation 
corresponding to {PP (x)}. 


14. Let {P,(x)} be a sequence of orthogonal polynomials on the interval 
(a,b). Show that the zeros of P,,(x) are real, distinct, and lie in (a, b). 


15. In the following justify that y(x) satisfies the given differential 
equations: 


(a) y” — 2ary! + 2ny =0; y(x) = H, (2). 
(b) ry H (a+1-— ry +ny= 0; y(x) = L(x). 
1—2?)y + {(G-—a) — (a+ B+ 2)a}y +n(n+a+b+1)y = 


9.6 Minimal Solutions, Continued Fractions, 
and Orthogonal Polynomials 


The intimate connection between continued fractions and orthogonal poly- 
nomials is now apparent in light of the fundamental recurrence formulas 
for continued fractions and orthogonal polynomials. If {P,,(a)} is a monic 
orthogonal polynomial sequence on the interval (a, b), with P_,(x) = 0 and 
P(x) = 1, then it must satisfy the difference equation 


Past — (@ — Bp) Pale) + YaPailz) = 90, ne Zr. (9.6.1) 
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To find the continued fraction that corresponds to (9.6.1) we take bn = 
—(a — By), an = Yn in (9.1.6). We then have the continued fraction 


Yo Yı Y2 
K e e (9.6.2) 
Moreover, P(x) is the nth partial denominator of the continued fraction 
(9.6.2). 

Next we focus our attention on finding a minimal solution of (9.6.1). Re- 
call from Pincherle’s theorem that (9.6.1) has a minimal solution if and only 
if the continued fraction K converges. To accomplish our task we need to 
find another polynomial solution Qn (x), called the associated polynomials, 
that forms with P,(«) a fundamental set of solutions of (9.6.1). 

Define 


b 
Qn(x) = I le) Fl) 06) dt. (9.6.3) 


Lemma 9.14. The set {P (£), Qn(x)} is a fundamental set of solutions 
of (9.6.1). 


PROOF. From (9.6.1), we have 
Pr4i(@) — Proi(t) = (x — t)Pa(t) + (£ — Bn)[Pr(@) — Pr(t)] 
= Vol Pale) = Pa-1 (6). 
Dividing by x — t and integrating yields 


b 
ORE f Poudre- Paai nea RHO 18, 
with 


Q-ı(z)=0, Qo(x) = 0. 
Notice that by the orthogonality of {P,(«)} we have 
b b 0 ifn>0, 
J P,(t)w(t) dt = J P,(t)Po(t)w(t) dt = 
a a Ho if n = 0. 
Hence, we obtain 


Qn4i(Z) — (£ — Bn)Qn(Z) + YnQ@n-1(z) = 0, 
Qo(x) =0, Qi(a) = po. (9.6.4) 
Since Po(x) = 1, Pi (x) = x — bo, the Casoratian W(0) of P, and Qn at 
n = 0 is equal to uo Æ 0, which implies that {P,,(x)} and {Q,,(a)} are two 
linearly independent solutions of (9.6.1). 
Observe that the polynomial sequence Qn (x) is the nth partial numerator 
of the continued fraction K. Hence if 
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exists, then by Pincherle’s theorem, the minimal solution of (9.6.1) exists 
and is defined by 


Sn(x) = F(x) P(x) — Qr(2). (9.6.5) 


Furthermore, if we let yo = po and Q_1(x) = —1, then Sn(x) satisfies 
(9.6.1) not only for n > 1, but also for n = 0, with S_,(a) = —1. 

To find an explicit formula for the minimal solution S(x) we need to 
utilize complex analysis. Henceforth, we replace the variable x by z in 
all the considered functions. From a result of [113], F(z) has the integral 
representation 


b 
F@)= f CF z g (a,b). (9.6.6) 


z—t 


Combining this formula with (9.6.3) produces the following integral 
representation of Sn (z): 


Soe if * Pal) ice de (9.6.7) 


Remark: 


(i) If (a,b) is a finite interval, then the existence of the minimal solution 
Sin(z) is always guaranteed (see [113]). 


(ii) If (a,b) is a half-infinite interval of the form (a,0o) or (—oo,b), then a 
sufficient condition for the existence of the minimal solution is 


Co 


5 ie =o 


(see [66]). 


(iii) If (a,b) = (—oo, ov), then a sufficient condition for the existence of the 
minimal solution Sn (z) is 


oo oo 
—1/2n 1/2. 
y Hon = 00, or y ney / = O0. 
n=1 n=1 


Proofs of these remarks are beyond the scope of this book and will be 
omitted. For details the reader may consult [66], [113]. 


Example 9.15 [145]. Consider the difference equation 
Pn4i(z) — 2Pn(z) + %nPra-i(z) =0, n>0, (9.6.8) 
with 
n(n + 2v —1) 
A(n+v)(n+v—1)’ 


Yn = y>1. 
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Notice that P,,(z) is related to the Gegenbauer polynomials P”(z) by the 
relation 


P,,(z) = wiv), e) (9.6.9) 


where 
T(v+n) 


(v)n =V(v +1)(v+2)---vtn—-l)= a 


(9.6.10) 


denotes the Pochhammer symbol. Hence by formula (9.6.7), a minimal 
solution of (9.6.8) is given by 


n! 1 v _ +42\v—1/2 
Se mer. I POO 2. dt, zeli 


Using the value of the integral found in Erdélyi et al. ([54, p. 281]) yields 


(n+v)n 
Qn+v— an+v—3/2"* 


n! yT TOUD (22 — 1) DAQU- E ), (9.6.11) 


Sn(z) = 


where Q8(z) is a Legendre function defined as 


(z — 1)8/2-2-1 


2 
QÊ (z2) = LT (a+ 1) F(atia-6+1;20+2% z), 
-z 


Gr 
with 
F(a, b; c; z) = 2 tks (\z| < 1). (9.6.12) 


The function F(a, b; c; z) is called a hypergeometric function [110]. 


Quite often it is possible to find an asymptotic representation of the 
minimal solution using the methods of Chapter 8. The following example 
demonstrates this point. 


Example 9.16. (Perturbations of Chebyshev Polynomials [71]). 


Consider again a monic orthogonal polynomial sequence {P,,(x)} repre- 
sented by the second-order difference equation 


Qnsi(2) — (2 = an)Qn(2) + bnQn—1(z) =0 (9.6.13) 


with Q_1(2) =0, Qo(z) =1. 

The (complex) Nevai class M (a,b) [106] consists of all those orthogonal 
polynomial sequences such that limpo dn = a, limn_+o5 bn = b. Without 
loss of generality we take a = 0 and b = 4. (Why?) Then the limiting 
equation associated with (9.6.1) is given by 


Prai(z) — zPa (2) + EPa?) =0. (9.6.14) 
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Observe that {P,,(z)} are the monic Chebyshev polynomials, which can 
be obtained (Appendix F, No. 4) by setting P,(z) = 217” T,,(z) (since 
2”~1 is the leading coefficient in T,,(z)), where {Tp (x)} are the Chebyshev 
polynomials of the first kind. Equation (9.6.14) has two solutions, 

P(g) = 202), and P3 (2)=A2(2), 2A ii, (9.6.15) 
where 


A+(z) = (z+ vz? —1)/2 and A_(z) = (z— V2? -1)/2. 


Observe that if z € C\[-1,1], we can choose the square root branch such 
that 


e <1. 


à-(2) 
Hence P} (z) is a minimal solution on z € C\[-1,1], and Pł (z) is a 
dominant solution on z € C\[-1, 1]. 
Now, the boundary values of the minimal solution on the cut 


P, (x + i0) = Jim, P, (x + te) = (à-(x))”, 


Py (æ — i0) = lim, Py (x — ie) = (A4 (2))", 


with 
à-(x) = (x — v 1 — x?)/2, A(x) = (x FiV1—2?)/2, xe(—1,1), 


yields a ratio of solutions that oscillates as n — oo. Thus there is no minimal 
solution for z = x € (—1, 1). 

Next we turn our attention to (9.6.13). Since |A,(z)| 4 |A_(z)|, by 
virtue of the Poincaré—Perron theorem there are two linearly independent 
solutions Q} (2), Q7 (z) of (9.6.13) such that 


So = A(z), lim @n+(2) 
Furthermore, Q} (z) is a dominant solution and Q;, (z) is a minimal solution 
of (9.6.1) for z € C\[-1, 1]. 

Moreover, if 


= A_(z). 


CO 


SS Jan| + 


n=0 


1 


then by Corollary 8.30, we have 
Qz (2) =A (2)(1 + o(1)), z€ C1, 1, 
Qn (z) =A} + o(1)), z € C\[-1, 1], 


where Q; and Q} are, respectively, minimal and dominant solutions 
of (9.6.13). Furthermore, for z = x € (—1,1), there are two linearly 
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independent solutions 


Qn(# + 10) = (A-(a))"(i + 0(1)),  Qn(w — 10) = (Az (2))” (i — o(1)), 


where 


à-(x)=x— iyl- zr?, A(t) = z+iy1-zr?. 
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For relaxing condition (9.6.16) and more generalizations, the reader is 
referred to [38]. 


Exercises 9.6 


1 


2 


. Show that 
Hop (2) = (-1)"2??nt LP? (2°), 
Honyi(£) = (—1)"2?"44 nt LC! (2?), 
. Show that 
T,(x) = 2 (nt)? p(-1/2,-1/2) (x), 
(Qn)! ” 


anin +1)! 
: = pO/2,1/2) : 


In Problems 3 through 6 investigate the existence of a minimal solution 
for the given polynomial. If a minimal solution exists, find an explicit 
representation for it. 


3. 
4. 
5. 
6. 
a, 


Legendre polynomials {P,(x)} (See Appendix F, No. 3). 
Hermite polynomials {H„(x)} (See Appendix F, No. 6). 
Laguerre polynomials {L°(a)} (See Appendix F, No. 7). 
Charlier polynomials {C\} (See Appendix F, No. 8). 
Use Rodrigues’ formula for the Legendre polynomial P,,(x) and the 
Cauchy integral formula? for the nth derivative to derive the formula 
(Schafli’s integral) 
P, (x) : fora (9.6.17) 
n(Z) = ; 6. 
N Oe a a 
where y is any positively directed simple closed curve enclosing the 
point x (x may be real or complex). 
2 f°) (z0) = wu L eean dz, n = 0, 1, 2, ..., where y is any positively 


directed closed curve enclosing zo. 
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Generating functions [110]. Suppose that G(x, u) is a polynomial with the 
Maclaurin expansion 


G(a,u) = 5 Qr(x)u”. 
n=0 


Then G(z,u) is called a generating function for {Q,(x)}. 
*8. (a) Show that 


i; (f: =y t + z Dro = G(a,h). 


27% 
(b) Deduce from (a) that the generating function of P,, (a) is given by 
G(a,u) = (1 — 2au+ u?) 1/2. 
*9. Consider the Chebyshev polynomials of the first kind {T,,(x)}. 


—1)"n! 2r n ene 
(a) Show that Ta(2) = ERr “EF f ae. 


(b) Then use (a) to verify that the generating function of T,,(z) is 
given by 
1— u? 
2(1—2ru +u?) 2 
*10. Consider the Gegenbauer polynomials P¥ (æ). 


(a) Show that 


G(x,u) = 


(—1)” (2v +n — 1)!(v — 3)! = pry 
(a) = ) f z 
(2v = 1) +n- 35)! -— x?) (z — x) 
(b) Show that the generating function of PY (x) is G(x,u) = (1 — 
2u + u?) ”. 
*11. Consider the Hermite polynomials {H„(£)}. 
(a) Show that 


Bla) = Ural f ete? 2), 


(b) Show that 


exp(2ux — u’) = 


Me 
x 
O 

e 
3 


n=0 
12. Consider the Laguerre polynomials {L2 (x)}. 
(a) Show that 
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(b) Show that the generating function of {L°(x)} is 


G(z,u) = (1-727! exp { ae \ 


1-2 


10 
Control ‘Theory 


10.1 Introduction 


In the last three decades, control theory has gained importance as a dis- 
cipline for engineers, mathematicians, scientists, and other researchers. 
Examples of control problems include landing a vehicle on the moon, con- 
trolling the economy of a nation, manufacturing robots, and controlling the 
spread of an epidemic. Though a plethora of other books discuss contin- 
uous control theory [6], [75], [96], we will present here an introduction to 
discrete control theory. 

We may represent a physical system that we intend to control by the 
homogeneous difference system 


x(n +1) = Az(n), (10.1.1) 


where A is a (k x k) matrix. We extensively studied this equation in 
Chapters 3 and 4; here we will refer to it as an uncontrolled system. 

To control this system, or to induce it to behave in a predetermined 
fashion, we introduce into the system a forcing term, or a control, u(n). 
Thus, the controlled system is the nonhomogeneous system 


a(n +1) = Ax(n) + u(n). (10.1.2) 


In realizing system (10.1.2), it is assumed that the control can be applied 
to affect directly each of the state variables x1(n), v2(n),...,7%(n) of the 
system. In most applications, however, this assumption is unrealistic. For 
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example, in controlling an epidemic, we cannot expect to be able to affect 
directly all of the state variables of the system. 

We find another example in the realm of economics. Economists, and 
certain politicians even, would pay dearly to know how the rate of inflation 
can be controlled, especially by altering some or all of the following vari- 
ables: taxes, the money supply, bank lending rates. There probably is no 
equation like (10.1.2) that accurately describes the rate of inflation. Thus, 
a more reasonable model for the controlled system may be developed: We 
denote it by 


x(n+1) = Az(n) + Bu(n), (10.1.3) 


where B is a (k x m) matrix sometimes called the input matrix, and u(n) is 
an mx 1 vector. In this system, we have m control variables, or components, 
u(n), u2(n),...,Um(n), where m < k. 

In engineering design and implementation, the system is often repre- 
sented by a block diagram, as in Figures 10.1, 10.2. 

The delay is represented traditionally by 27t, since 4Z[a(n + 1)] = 
Z|x(n)]. (See Figure 10.3.) 


FIGURE 10.1. Uncontrolled system. 


Delay 


re x(n+1) Tz" | mre, 
+ 


FIGURE 10.2. Controlled system. 
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x(n+1) p x(n) 
— > z > 
z X(Z) x(Z) 


= 
| 
| 
| 
| 


H; u(t) Continuous x(t) S 


m System F, [>| [+> x(k) 


l 
| | 
| | 
Discrete system x, 


FIGURE 10.4. A continuous system with ideal sampler and zero-order hold. 


10.1.1 Discrete Equivalents for Continuous Systems 


One of the main areas of application for the discrete control methods de- 
veloped in this chapter is the control of continuous systems, i.e., those 
modeled by differential and not difference equations. The reason for this 
is that while most physical systems are modeled by differential equations, 
control laws are often implemented on a digital computer, whose inputs 
and outputs are sequences. A common approach to control design in this 
case is to obtain an equivalent difference equation model for the continuous 
system to be controlled. 

The block diagram of Figure 10.4 shows a common method of interfacing 
a continuous system to a computer for control. The system }>, has state 
vector x(t) and input u(t) and is modeled by the differential equation 


ilt) = A(t)a(t) + Bu(t). (10.1.4) 


The system Sr is an ideal sampler that produces, given a continuous signal 
x(t), a sequence x(k) defined by 


x(k) = a(kT). (10.1.5) 


The system Hry is a zero-order hold that produces, given a sequence u(k), 
a piecewise-constant continuous signal ue(t) defined by 


u(t)=u(k), t€ [kT,(k+1)T). (10.1.6) 


It is not hard to check that the solution to (10.1.4) for t € [kT, (k + 1)T) 
is given by 


; t : 
x(t) = e“*a(kT) +f e^t- Bu(r) dr. (10.1.7) 
kT 
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Thus a difference equation model for the overall system `q (indicated 
by the dotted box in Figure 10.4) can be obtained by evaluating formula 
(10.1.7) at t = (k + 1)T and using (10.1.5) and (10.1.6): 


a(k+1) = Ax(k) + Bu(k), (10.1.8) 
where 
A=e4T and B=Te4TB. (10.1.9) 


Example 10.1. A current-controlled DC motor can be modeled by the 
differential equation 


Oe -* a(t) + i ua, 


where x is the motor’s angular velocity, u is the applied armature current, 
and K and 7 are constants. A difference equation model suitable for the 
design of a discrete control system for this motor can be found using (10.1.8) 
and (10.1.9): 


x(k +1) = Aa(k) + Bu(k), 


where 


A=e4T =e-T/7 and B=Te4™ B= KE e TIE 
F 


10.2 Controllability 


In this section we are mainly interested in the problem of whether it 
is possible to steer a system from a given initial state to any arbitrary 
state in a finite time period. In other words, we would like to determine 
whether a desired objective can be achieved by manipulating the chosen 
control variables. Until 1960, transform methods were the main tools in 
the analysis and design of controlled systems. Such methods are referred to 
now as classical control theory. In 1960, the Swiss mathematician /engineer 
R.E. Kalman [77] laid down the foundation of modern control theory by 
introducing state space methods. Consequently, matrices have gradually re- 
placed transforms (e.g., Z-transform, Laplace transform), as the principal 
mathematical machinery in modern control theory [88], [108], [142]. 


Definition 10.2. System (10.1.3) is said to be completely controllable (or 
simply controllable) if for any no € Z*, any initial state x(no) = xo, and 
any given final state (the desired state) xp, there exists a finite time N > no 
and a control u(n),no < n < N, such that x(N) = zp. 


‘In some books such a system may be referred to as completely reachable. 
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Remark: Since system (10.1.3) is completely determined by the matrices 
A and B, we may speak of the controllability of the pair {A, B}. 


In other words, there exists a sequence of inputs u(0), u(1),...,u(N — 1) 
such that this input sequence, applied to system (10.1.3), yields z(N) = xy. 


Example 10.3. Consider the system governed by the equations 


x(n + 1) = ayxi (n) + ay242(n) + bu(n), 


xo(n + 1) = agaxe(n). 


Here 


It will not take much time before we realize that this system is not 
completely controllable, since u(n) has no influence on x2(n). Moreover, 
xo(n) is entirely determined by the second equation and is given by 
X2(n) = abyx2(0). 


The above example was easy enough that we were able to determine 
controllability by inspection. For more complicated systems, we are going 
to develop some simple criteria for controllability. 

The controllability matriz W of system (10.1.3) is defined as the k x km 
matrix 


W = |B, AB, A’B,..., A®~-1B]. (10.2.1) 


The controllability matrix plays a major role in control theory, as may be 
seen in the following important basic result. 


Theorem 10.4. System (10.1.3) is completely controllable if and only if 
rank W = k. 


Before proving the theorem, we make a few observations about it and 
then prove a preliminary result. 

First, consider the simple case where the system has only a single input, 
and thus the input matrix B reduces to an m x 1 vector b. Hence the 
controllability matrix becomes the k x k matrix 


W = [b, Ab,..., Atb]. 


The controllability condition that W has rank k means that the matrix W 
is nonsingular or its columns are linearly independent. For the general case, 
the controllability condition is that from among the km columns there are 
k linearly independent columns. Let us now illustrate the theorem by an 
example. 
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Example 10.5. Contemplate the system 

yi(n + 1) = ayı (n) + by2(n), 

y(n + 1) = cyı (n) + dyo(n) + u(n), 
where ad — bc Æ 0. Here 


E) 0 


and u(n) is a scalar control. Now, 


w-wa- (29 


has rank 2 if b # 0. Thus the system is completely controllable by Theorem 
10.4 if and only if b £0. 


Lemma 10.6. For any N È> k, the rank of the matrix 

[B, AB, A?°B,..., AN! B] 
is equal to the rank of the controllability matrix W. 
PROOF. (I) Consider the matrix W(n) = [B,AB,...,A"!B],n = 
1,2,3,.... As n increases by 1, either the rank of W(n) remains 
constant or increases by at least 1. Suppose that for some r > 1, 


rank W(r +1) = rank W(r). Then every column in the matrix A”B is 
linearly dependent on the columns of W(r) = [B, AB,..., A"~'B]. Hence 


A"B = BM)+ ABM, +--+ A" 'BM,_1, (10.2.2) 


where each M; is an m x m matrix. By premultiplying both sides of (10.2.2) 
by A, we obtain 


A’+1B = ABM) + A?7BM, + -+ A"BM,_1. 


Thus the columns of A’*'B are linearly dependent on the columns of W (r+ 
1). This implies that rank W(r +2) = rank W(r+1) = rank W(r). By 
repeating this process, one may conclude that 


rank W(n) = rank W(r) foralln >r. 


We conclude from the above argument that rank W(n) increases by 
at least 1 as n increases by 1 until it attains its maximum k. Hence 
the rank maximum of W(n) is attained in at most k steps. There- 
fore, the maximum rank is attained at n < k and, consequently, rank 
W (= rank W(k)) = rank W(N) for all N > k. 


ProoF. (II) In the second proof we apply the Cayley-Hamilton theorem 
(Chapter 3). So if p(A) = AF + p1A¥T! +--+ + pk is the characteristic 
polynomial of A, then p(A) = 0, i.e., 


AP +p A5! ot pT = 0, 
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or 


k 
A =X qA, (10.2.3) 


i=l 


where q; = —p;. Multiplying expression (10.2.3) by B, we obtain 
k 
ARB=S > qA*“B. (10.2.4) 
i=1 


Thus the columns of A* B are linearly dependent on the columns of W (k) = 
W. Therefore, rank W(k+1) = rank W. By multiplying expression (10.2.4) 
by A we have 


AFTIB = q AË + q2 AFT! +--+ QA. 


Consequently, rank W (k + 2) = rank W (k + 1) = rank W. By repeating 
the process, one concludes that rank W (N) = rank W for all N > k. 


We are now ready to prove the theorem. 
PROOF OF THEOREM 10.4. 


Sufficiency Suppose that rank W = k. Let xo and xp be two arbitrary 
vectors in R*. Recall that by the variation of constants formula (3.2.14) we 
have 


k-1 
a(k) — A*ka(0) = XD A+" Bu(r), 
r=0 


or 
x(k) — A*a(0) = Wak), (10.2.5) 
where 
u(k — 1) 
u(k — 2) 
a(k) = 
u(0) 


Since rank W = k, range W = R*. Hence if we let x(0) = xp and x(k) = £f, 
then xp—A*x, € range W. Thus xf — Azo = Wu for some vector u € R*. 
Consequently, system (10.1.3) is completely controllable. 


Necessity Assume that system (10.1.3) is completely controllable and 
rank W < k. From the proof of Lemma 10.6 (Proof I) we conclude that 
there exists r € Z* such that 
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rank W(1) < rank W(2) <---< rank W(r) 
= rank W(r+1)=---= rank W. 


Moreover, rank W(n) = rank W for all n > k. Furthermore, since W(j + 
1) = (W (j), AÍ B), it follows that 


range W(1) C range W(2) C--- C range W(r) 
= range W(r+1)=---=range W =---= range W(n) 


for any n > k. 

Since rank W < k, range W 4 R*. Thus there exists £ ¢ range W. 
This implies that € ¢ range W(n) for all n € Z*. If we let x = 0 in 
formula (10.2.5) with k replaced by n, we have x(n) = W(n)ti(n). Hence 
for £ to be equal to x(n) for some n, € must be in the range of W (n). But 
E grange W(n) for all n € Zt implies that € may not be reached at any 
time from the origin, which is a contradiction. Therefore, rank W = k. 


Remark 10.7. There is another definition of complete controllability in 
the literature that I will call here “controllability to the origin.” A system 
is controllable to the origin if, for any no € Zt and ao € R*, there exists a 
finite time N > no and a control u(n),no < n < N, such that «(N) = 0. 


Clearly, complete controllability is a stronger property than controlla- 
bility to the origin. The two notions coincide in continuous-time systems. 
(See [75].) However, for the discrete-time system (10.1.3), controllability to 
the origin does not imply complete controllability unless A is nonsingular 
(Exercises 10.1 and 10.2, Problem 13). The following example illustrates 
our remark. 


Example 10.8. Consider the control system a(n + 1) = Az(n) + Bu(n) 


with 
(a) eG) 
A= p BS A (10.2.6) 
0 0 0 


Now, for 


we have, from (10.2.6), 
x(1) = Axo + Bu(0) 


0 1 LO. 1 
“(5 o) Ct 
0 
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So if we pick u(0) = —2o2, then we will have x(1) = 0. Therefore, system 
(10.2.6) is controllable to zero. Observe, however, that 


1 0 
rank (B, AB) = rank ( s) =] <2 


Thus by Theorem 10.4, system (10.2.6) is not completely controllable. 


Example 10.9. Contemplate the system y(n+1) = Ay(n)+ Bu(n), where 


m6) 


1 1 
Now, W(1) = () is of rank 1, and W(2) = ( 


1 
is also of rank 1, 
1 1 


1 1 
since it is now equivalent to f ) . Hence according to Theorem 10.4 
—4 
the system is not controllable. Notice, however, that the point 0 is 


1 
reachable from 9 under the control u(n) = —2 in time n = 2. 
Example 10.10. Figure 10.5 shows a cart of mass m attached to a wall 
via a flexible linkage. The equation of motion for this system is 
më + bt + kz = u, (10.2.7) 


where k and b are the stiffness and damping, respectively, of the linkage, 
and u is an applied force. Equation (10.2.7) can be written in state variable 


FIGURE 10.5. A cart attached to a wall via a flexible linkage. 
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£ _ 0 1 x 0 
ol —k/m —b/m| |v T 1/m Us 1028) 


x 0 1 z 0 
A= , B= : 
—k/m —b/m 1/m 
Recall that, given a sample period T, the matrices A and B of the equivalent 
discrete system are given by 


form as 


Thus 


A= eAT B= TeAT Ê, 
so that their computation requires finding the exponential of the matrix A. 


This is not so difficult as it sounds, at least when A can be diagonalized, 
for then we can find a matrix P such that 


A= PAP, (10.2.9) 


where A is a diagonal matrix 


Asji Hee Sar ls (10.2.10) 


By definition, 


A A 1. 1» 
ÂT_ pr, i 2m2 | 373 4, 
e =I+AT+ FAT t AT 
so that substituting using (10.2.9) gives 
gar = Pe^T P-L, 


and the diagonal form (10.2.10) of A gives 


Returning to our example, note that if m = 1, k = 2, and b = 3, then 


fe) fh 


Thus A can be written in the form of (10.2.9), where 


-1 0 1 1 
, P= 
0 el È “| 


A= 
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Hence 
cr 
ÂT E 0 =i 
A=e" = | es: P 
2e7T — mec ete? 
Oi eoers +2e7?T eTa A , 


The controllability of the discrete equivalent system can then be checked 
by computing 


W=[B AB|=T 


Checking the determinant gives 
det W = —T’e-*7(1—e 7 + e777), 


which is zero only if T = 0. Thus the cart is controllable for any nonzero 
sample period. 


10.2.1 Controllability Canonical Forms 
Consider the second-order difference equation 
2(n+ 2) + piz(n+1)+ poz(n) = u(n). 
Recall from Section 3.2 that this equation is equivalent to the system 
a(n+1) = Azr(u) + Bu(n), 


where 


Clearly, 


has rank 2 for all values of pı and po. Consequently, this equation is always 
completely controllable. 
The preceding example may be generalized to the kth-order equation 


z(nt+k)+piz(n+k+1)+---+pez(n) = u(n), (10.2.11) 
which is equivalent to the system 


x(n +1) = Azr(n) + bu(n), 
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where 
0 1 0 0 
0 
A= 0 1 : , B=e,=|:], 
1 
1 
—Pk ~—Pk-1 °°" Pl 
z(n) 
z(n+ 1) 
a(n) = i 
z(n+k-1) 
Notice that 
0 
0 
AB=| : |, ÆB= , -AIB = | 
1 * 
Pl ¥ 


where the *’s are some combinations of the products of the p,’s. It follows 
that 


0 0 1 
W=]: 
0 x 
1 x 


is of rank k, and so the equation, and thus the system, is completely con- 
trollable. The converse of the above statement is also valid. That is to say, 
if system (10.1.3), with k x 1 vector B = b, is completely controllable, then 
it can be put in the form of a kth scalar equation (10.2.11) by a similarity 
transformation. To accomplish this task we start with the k x k controlla- 
bility matrix W = (b, Ab,..., A*~1b). Since system (10.1.3) is completely 
controllable, it follows from Theorem 10.4 that W is nonsingular. Let us 
write WT! in terms of its rows as 


WI 


W2 
wt = 


Wk 
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We claim that the set {wp, weA,...,w,A*—1} generated by the last row of 
W7! is linearly independent. To show this, suppose that for some constants 
a1, @2,..., akg we have 


awg + azWwk A+: +apwp AFT! = 0. (10.2.12) 

Multiplying (10.2.12) from the right by b yields 
aiwpb + agw Ab +--+» + a,w,A*—1b = 0. (10.2.13) 
Since W-!W = I, it follows that wb = wk Ab = --- = wpA*-?b = 0 
and w,A*—1b = 1. Hence it follows from (10.2.13) that a, = 0. One may 
repeat this procedure by multiplying (10.2.12) by Ab (and letting a, = 0) to 
conclude that a,_1 = 0. Continuing this procedure, one may show that a; = 


0 for 1 < i < k. This proves our claim that the vectors wg, wy A,..., wp AFT! 
are linearly independent. Hence the k x k matrix 


wWrA 
P = 


wp At! 
is nonsingular. Define a change of coordinates for system (10.1.3) by 
z(n) = Px(n), (10.2.14) 
which gives 


z(n +1) = PAP~'2z(n) + Pbu(n), 


or 
z(n +1) = Az(n) + bu(n), (10.2.15) 
where 
Â= PAP, b= Pb. (10.2.16) 
clearly, 
b= Pb = 
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Now, 


WrA 


wg A? 
Â= PAP! = j Pot 


wp A" 


Since wA is the second row in P, it follows that 


wpAP™=(0 1 0 0). 
Similarly, 
wrA?P-'=(0 010 -:: 0), 
wp ATIP! = (0 0 +> 0 1). 
However, 
wp AFP! = (~pe —Pe-1 © — D1); 


where the p;’s are some constants. Thus 


0 1 0 0 
0 0 1 0 
Aer | 3 
0 0 0 oe 1 
—Pk ~—Pk-1 ~Pk-2 ‘t ~Pl 


with characteristic equation 
AFE + py dF! + podP-? +--+ pk = 0. 


Observe that A and A have the same characteristic equation. The above 
discussion proves the following. 


Theorem 10.11. A system x(n +1) = Aaz(n) + bu(n) is completely con- 
trollable if and only if it is equivalent to a kth-order equation of the form 
(10.2.11). 


System (10.2.15) is said to be in a controllable canonical form. 


Another controllable canonical form may be obtained by using the change 
of variables x(n) = W2z(n), where W is the controllability matrix of the 
system. This is a more popular form among engineers due to its simple 
derivative. The reader is asked in Exercises 10.1 and 10.2, Problem 20, to 
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show that the obtained controllable canonical pair {A,b} are given by 


000 Be 
10 0 —Pk-1 
0 0 =p] 


Exercises 10.1 and 10.2 


1 


(10.2.17) 


In Problems 1 through 6 determine whether or not the system x(n + 1) = 
Az(n) + Bu(n) is completely controllable. 


1. 


2 


e 
A= 
1 


Au 
0 


A= 


ao) 


1 0 0 0 
—2 1 0 0 
0 -2 ol, eS 
0 0 —5 1 0 
0 0 0 —5 2 
1 0 0 0 0 
—2 1 0 0 3 
o -2 0o of, B=lo 
0 —5 1 2 
0 0 5 0 
A12 Bı 
Aa)? o)’ 


e O O O e 


O =. O O me 


Ay, is an r x r matrix, Ajo is an r x s matrix, As is an s X s matrix, 
Bı is an r x m matrix, where r + s = k. 


We say that a state xp is reachable from an initial state xo if there 
exists N € Z* and a control u(n), n = 0,1, 
x(N, xo) = zf. 


a, —ANao € range W(N). 


..,N — 1, such that 


. Prove that a state x is reachable from zo in time N if and only if 
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8. Consider the system x(n + 1) = Ax(n) + Bu(n), where 


TP Et 0 
A=!0 1 o|, B=lo 
a ae 1 


Find a basis for the set of vectors in R° that are reachable from the 
origin. 
9. Consider the system 
-1 —1 
a(n+1)= 5 i x(n) + Bu(n). 


Find for what vectors B in R? the system is not completely 
controllable. 


10. Obtain a necessary and sufficient condition for 
zın +1) = ay141(n) + aizzo(n) + u(n), 


xvo(n + 1) = azzi (n) + ag2x2(n) — u(n), 


to be controllable. 


11. Obtain a necessary and sufficient condition for a(n +1) = Aa(n) + 
Bu(n) to be completely controllable, where 


12. Consider the system 
ri(n +1) = z2(n) + u(n) + ua(n), 
r2(n +1) = x3(n) + u(n) — u2(n), 


r3(n +1) = u(n). 


(a) Prove that the system is completely controllable in two steps. 


(b) If ua(n) = 0, show that the system is completely controllable in 
three steps. 


(c) If ui(n) = 0, show that the system is not completely controllable. 


13. Show that if the matrix A in (10.1.3) is nonsingular, then complete 
controllability and controllability to the origin are equivalent. 


14. Prove that if U = WWT is positive definite, then W has rank k, where 
W is the controllability matrix of (10.1.3). Prove also the converse. 


15. Show that system (10.1.3) is completely controllable if [B, AB,..., A*~"] 
has rank k, where r = rank B. 


16. 


17. 


18. 


19. 


20. 


21. 
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A polynomial (A) = A” +a1A™7! +- - -+am is said to be the minimal 
polynomial of a k x k matrix A if y(A) is the lowest-degree polynomial 
for which y(A) = 0. It follows that m < k. Prove that system {A, B} 
is completely controllable if and only if rank|B, AB,..., A"~"B] = k, 
where rank B=r. 


For a k x k matrix A and a k x m matrix B, prove that the following 
statements are true: 


(i) If {A, B} is completely controllable, then so is {A + BC, B} for 
any m x 1 vector C. 


(ii) If {A + BC, B} is completely controllable for some m x 1 vector 
Co, then {A + BC, B} is completely controllable for any m x 1 
vector C. 


Consider the system x(n + 1) = Ax(n) + Bu(n), where A isa k x k 
matrix, B isa kxm matrix, and such that A has k linearly independent 
eigenvectors. Prove that {A, B} is completely controllable if and only 
if no row of P~'B has all zero elements, where P = (£,...,€,), the 
€,’s being the eigenvectors of A. 


Suppose that in Problem 18, A does not possess k linearly indepen- 
dent eigenvectors and that there exists a nonsingular matrix P where 
P~'AP = J is the Jordan canonical form of A. Prove that {A, B} is 
completely controllable if and only if: 


(i) no two Jordan blocks in J are associated with the same eigenvalue, 


(ii) the elements of any row of P~'B that correspond to the last row 
of each Jordan block are not all zero, and 


(iii) the elements of each row of P~'B that correspond to distinct 
eigenvalues are not all zero. 


(Another controllability canonical form). Consider the completely con- 
trollable system x(n + 1) = x(n) + bu(n), where b is a k x 1 vector. 
Let a(n) = Wz(n), where W is the controllability matrix. Then the 
system becomes z(n + 1) = Az(n) + bu(n). Show that A and b are 
given by (10.2.17). 


Consider the system x(n + 1) = Ax(n) + Bu(n), where 


1 0.6 0.4 
A= , B= ; 
0 0.4 0.6 
The reachability set is defined by R(n) = {x(0): x(0) is reached from 
the origin in N steps with |u()| <1,1<i< N}. 
(a) Find R(1) and plot it. 
(b) Find R(2) and plot it. 
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FIGURE 10.6. Output is the same as the state: y(n) = x(n). 


10.3 Observability 


In the previous section it was assumed that (the observed) output of the 
control system is the same as that of the state of the system x(n). In 
practice, however, one may not be able to observe the state of the system 
x(n) but rather an output y(n) that is related to x(n) in a specific manner. 
The mathematical model of this type of system is given by 


y(n) = Cx(n), (10.3.1) 


where A(n) isa k x k matrix, B a k x m matrix, u(n) an m x 1 vector, and 
C an r x k matrix. The control u(n) is the input of the system, and y(n) 
is the output of the system, as shown in Figures 10.6, 10.7. 

Roughly speaking, observability means that it is possible to determine 
the state of a system z(n) by measuring only the output y(n). Hence it 
is useful in solving the problem of reconstructing unmeasurable state vari- 
ables from measurable ones. The input-output system (10.3.1) is completely 
observable if for any no > 0, there exists N > no such that the knowledge 
of u(n) and y(n) for no < n < N suffices to determine x(no) = zo. 


Ore | : x(n+1) Ure) s 


FIGURE 10.7. Input-output system: y(n) = Cz(n). 
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x,(n+1) x(n) 


y(n) 


FIGURE 10.8. A nonobservable system. 


Example 10.12. Consider the system (Figure 10.8) 


) = azı (n) + biu(n), 


za(n + 1) = azzə(n) + bou(n), 


zın + 


This system is not observable, since the first equation shows that zı(n) = 
y(n) is completely determined by u(n) and x1(0) and that there is no way 
to determine x2(0) from the output y(n). 

In discussing observability, one may assume that the control u(n) is iden- 
tically zero. This obviously simplifies our exposition. To explain why we 
can do this without loss of generality, we write y(n) using the variation of 
constants formula (3.2.14) for x(n): 


y(n) = Ca(n), 
or 
n-1 
y(n) = CA” ™ zo + y. CA"5—" Bu(j). 
j=no 


Since C, A, B, and u are all known, the second term on the right-hand side 
of this last equation is known. Thus it may be subtracted from the observed 
value y(n). Hence, for investigating a necessary and sufficient condition for 
complete observability it suffices to consider the case where u(n) = 0. 


We now present a criterion for complete observability that is analogous 
to that of complete controllability. 
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Theorem 10.13. System (10.3.1) is completely observable if and only if 
the rk x k observability matrix 


va| CA (10.3.2) 


CAK} 
has rank k. 


PROOF. By applying the variation of constants formula (3.2.14) to 
(10.3.1) we obtain 


y(n) = Ca(n) = C | A” £o + y A”! Bu(r)| . (10.3.3) 
r=0 
Let 
ln) = y(n) — SD CA" Bur), (10.3.4) 
r=0 


Using formula (10.3.3), equation (10.3.4) may now be written as 
p(n) = CA” xo. (10.3.5) 
Putting n = 0,1,2,...,4—1 in (10.3.5) yields 
ea lee 
g(1) CA 
= ; Xo. (10.3.6) 
g(k — 1) GAFI 


Suppose that rank V = k. Then range V = RF. Now, if y(n), u(n) are 
given for 0 < n < k — 1, then it follows from (10.3.4) that ĝ(n), 0 < n < 
k — 1, is also known. Hence there exists £o € R* such that (10.3.6) holds. 
Hence system (10.3.1) is completely observable. Conversely, suppose system 
(10.3.1) is completely observable. Let us write 

C 


CA 
vin) =| CA’ | = (07, ATCT, (AT)?CT,...,(AT)N—1CT)”. 


CAN! 
(10.3.7) 
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Then from Theorem 10.13, V (N) is of rank k if and only if the observability 
matrix V = V (k) has rank k. Therefore, if zo can be uniquely determined 
from N observations y(0), y(1), ...,y(N—1), it can be so determined from 
y(0),y(1), ...,y(K — 1). Thus rank V = k. 


Notice that the matrix B does not play any role in determining observ- 
ability. This confirms our earlier remark that in studying observability, one 
may assume that u(n) = 0. Henceforth, we may speak of the observability 
of the pair {A,C}. 


Example 10.3 revisited. Consider again Example 10.3. The system may 
be written as 


ri(nt+1)\ fa 0 x1(n) by 
(seen) (e a) Gra) + Gi) e 


ay 


Thus A = and C = (1 0). It follows that the observability 


a2 
matrix is given by V = (1 a1) (0 0) . Since rank V = 1 < 2, the system 
is not completely observable by virtue of Theorem 10.13. 


Finally, we give an example to illustrate the above results. 
Example 10.14. Consider the input-output system (Figure 10.9) 
zı(n +1) = x2(n), 
xvo(n + 1) = =z (n) + 2x9(n) + u(n), 
zın) + c2X9(n). 


y(n) =e 
0 1 0 zi 
Then A = a Se vB ie and C = (c1,c2). The observability 


C Cy C2 
V= = : 
CA —C2 C1 + 2Co 


By adding the first column to the second column in V we obtain the matrix 


A Cy C1 T C2 
V= : 
—C2 Ci + C2 


Observe that rank V = 2 if and only if cı +c2 # 0. Since rank V = rank V, 
it follows that the system is completely observable if and only if c1 +c. Æ 0 
(or co # —c1). 


We may also note that the system is completely controllable. 


matrix is given by 
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7 A A, Gyn) 


{ -1 |< 


FIGURE 10.9. A completely observable and controllable system. 


Example 10.15. Example 10.10 looked at the controllability of a cart 
attached to a fixed wall via a flexible linkage using an applied force u. 
A dual question can be posed: If the force on the cart is a constant, can 
its magnitude be observed by measuring the cart’s position? In order to 
answer this question, the state equation (10.2.8) must be augmented with 
one additional equation, representing the assumption that the applied force 
is constant: 


x 0 1 0 x 
bo] = |-k/m —b/m 1/m| |v], 
ù 0 0 0 u 


x 
y=(1 0 O] lv 
u 


Using the same values m = 1, k = 2, and b = 3 as in Example 6.10, 


0 1 0 
A=|-2 -3 1 
0 0 0 
can be written as 
Â= PAP! 


where 
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Thus 
A= eôT = Pe^T p-! 
92e-T — e-?T pa Fp 2T Dh ae bed sett 
aoe? oer og Ree oe eet Siero 
0 0 1 


To check observability, we must compute 


C 
V= | CA 
CA? 
1 0 0 
| |2eT— eT eT 2 E tae! pan 
= 2 2 
peta go eT eT Se Pn Bet yp eiT 


and its determinant 


det V =e 7 + 2e7?T — 4e~3T — 2e-47 + 3e75T 


apt (bte Whe Ais 3e7T). 


The factored form above shows that since T is real, det V = 0 only if T = 0. 
The system is therefore observable for all nonzero T. 


Theorem 10.13 establishes a duality between the notions of controllability 
and observability. The following definition formalizes the notion of duality. 


Definition 10.16. The dual system of (10.3.1) is given by 
a(n +1) = A?a(n) + CTu(n), 
y(n) = BT x(n). (10.3.8) 


Notice that the controllability matrix W of system (10.3.8) may be given 
by 


W = [C7, ATCT, (ATCT, ..., tA yr |. 


Furthermore, the observability matrix V of system (10.3.1) is the transpose 
of W, i.e., 


V=WŴ". 
But since rank W = rank WT = rank V, we have the following conclusion. 


Theorem 10.17 (Duality Principle). System (10.3.1) is completely 
controllable if and only if its dual system (10.3.8) is completely observable. 
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det A #0 — — 
complete controllability oon Se controllability to the origin 
dual dual 


detAz#0 | 


complete observability RASS Ses constructibility 


FIGURE 10.10. 


Remark: In Remark 10.7 we introduced a weaker notion of controllability, 
namely, controllability to the origin. In this section we have established 
a duality between complete controllability and complete observability. To 
complete our analysis we need to find a dual notion for controllability to the 
origin. Fortunately, such a notion does exist, and it is called constructibility. 
System (10.3.1) is said to be constructible if there exists a positive integer 
N such that for given u(0),u(1), ...,u(N — 1) and y(0), y(1), ...,y(N — 
1) it is possible to find the state vector x(N) of the system. Since the 
knowledge of (0) yields z(N) by the variation of constants formula, it 
follows that complete observability implies constructibility. The two notions 
are in fact equivalent if the matrix A is nonsingular. Figure 10.10 illustrates 
the relations among various notions of controllability and observability. 


Finally, we give an example to demonstrate that constructibility does 
not imply complete observability. 


Example 10.18. Contemplate a dual of the system in Example 10.8: 
+1 0 0 1 
zı(n + 1) _ x(n) r T 
x(n + 1) 1 O} \ae(n) 0 


The observability matrix is given by 


10 
V= 


whose rank is 1. It follows from Theorem 10.13 that the system is not 
completely observable. However, if we know u(0), u(1) and y(0), y(1), then 
from the second equation we find that xı(1) = y(1). The first equation 
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is now obtained and, consequently, the system is constructible. 


10.3.1 Observability Canonical Forms 


Consider again the completely observable system 


x(n +1) = Azr(n) + bu(n), 
y(n) = Cx(n), (10.3.9) 


where b is a k x 1 vector and C is a 1 x k vector. Recall that in Section 
10.2 we constructed two controllability canonical forms of system (10.3.1). 
By exactly parallel procedures we can obtain two observability canonical 
forms corresponding to system (10.3.9). Both procedures are based on the 
nonsingularity of the observability matrix 


C 
CA 


TRE 


If we let z(n) = Va(n) in (10.3.11), we obtain the first observability 
canonical form (Exercises 10.3, Problem 10) 


y(n) =€ z(n), (10.3.10) 
where 
0 1 0 0 
0 0 1 0 
A= ; 
0 0 0 1 
—Pk —Pk-1 —Pk-2 Pi 
=(100 - 0), 


Z 
b= Vb. (10.3.11) 
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In Exercises 10.3, Problem 10, the reader is asked to find a change of 
variable that yields the other observability canonical form {A, č}, with 


0 0 ... O -Pk 
1 0 ... O —pk-ı 

Ã=|0 1 0 pee. č=(0 0 > 1). (10.3.12) 
0 0... 1 =pi 


Exercises 10.3 
1. Consider the input-output system 


x(n +1) = Ax(n) + Bu(n), 
y(n) = Cx(n), 


0 1 
where A = ( : 
2 -1 


(a) If C = (0,2), show that the pair{A,C} is observable. Then find 
x(0) if y(0) = a and y(1) = b. 


(b) If C = (2,1), show that the pair {A,C} is unobservable. 


2. Determine the observability of the pair {A,C}, where 


0 1 0 

EE E Pne? Y, 
Ada 2 Bs: iL 
4 4 


3. Consider the system defined by 
zı(n+1)\ fa b\ fz(n) 1 A 
a e 
_ x1(n) 
y(n) = (1 0) ee ; 


Determine the conditions on a,b,c, and d for complete state control- 
lability and complete observability. In Problems 4 and 5, determine the 
observability of the pair {.A, C}. 


10. 


11. 


12. 
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210 0 0 
02 1 0 0 
11101 
A=ļ0 0 2 0 of, o=( 
01110 
000 -3 1 
000 0 -3 
210 0 0 
021 0 0 
11101 
ĘA=ļ0 02 0 o0], C= 
01100 
000 -3 1 
000 0 -3 


. Show that the pair {A,C}, where 


Ay, 0 - C=(C 0), Air xr; Azx:m x r; 
Ao, Age Ago:mxm;, Cy: px7; 


is not completely observable for any submatrices A1, A21, A22, and Cj. 


. Prove that system (10.3.2) is completely observable if and only if 


rank[C,C'A,...,CA™-"|? = k, where m is the degree of the minimal 
polynomial of A, and r = rank C. 


. Prove that system (10.3.2) is completely observable if and only if the 


matrix VTV is positive definite, where V is the observability matrix 
of {A,C}. 


. Show that the kth-order scalar equation 


z(n +k) + pi2(n-$ k— 1) +--+ pez(n) = u(n), 
y(n) = c 2(n), 
is completely observable if c Æ 0. 


Verify that the change of variable z(n) = Va(n) produces the 
observability canonical pair {A,é} defined in expression (6.3.13). 


Consider system (10.3.2), where P~!AP is a diagonal matrix. Show 
that a necessary and sufficient condition for complete observability is 
that none of the columns of the r x k matrix CP consist of all zero 
elements. 


Consider system (10.3.2), where P~' AP is in the Jordan form J. Show 
that necessary and sufficient conditions for complete observability of 
the system are: 
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13. 


14. 


15. 


16. 
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(i) no two Jordan blocks in J correspond to the same eigenvalue of 


A 


? 


(ii) none of the columns of CP that correspond to the first row of 
each Jordan block consists of all zero elements, and 


(iii) no columns of CP that correspond to distinct eigenvalues consist 
of all zero elements. 


Let P be a nonsingular matrix. Show that if the pair {A,C} is 
completely observable, then so is the pair {P7} AP, CP}. 


Show that if the matrix A in system equation (10.3.2) is nonsingular, 
then complete observability and constructibility are equivalent. 


Consider the completely observable system 


x(n +1) = Ax(n) + Bu(n), 
y(n) = Cx(n), 


where a is a k x k matrix and C is a 1 x k vector. Let M = 
(CHATO ea EC 


0 0 
0 1 0 
(a) Show that M7A(M7)-1 =| : all 
0 0 0 ta 1 
Qk Qk-1 Ak—2 eee TAL 
where a;,1 < i < k, are the coefficients of the characteristic 


polynomial 
[AZ — A] = AP + ay APo1 +--+ + ag. 


(b) Write down the corresponding canonical controllable system by 
letting %(n) = M7 x(n). Then deduce a necessary condition on C 
for complete observability of the original system. 


Consider the system 


a(n+1) = Az(n), 
y(n) = Cx(n), 


where A is a k x k matrix and C is a 1 x k vector. Prove that the 
system is completely observable if and only if the matrix 


G=(C,CA,CA~“, ..., CA7**) is nonsingular. 
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u(n) B - x(n+1) x(n) 


FIGURE 10.11. Open-loop system. 


10.4 Stabilization by State Feedback 
(Design via Pole Placement) 


Feedback controls are used in many aspects of our lives, from the braking 
system of a car to central air conditioning. The method has been used by 
engineers for many years. However, the systematic study of stabilization 
by state feedback control is of more recent origin (see [3], [4]) and dates 
to the 1960s. The idea of state feedback is simple: It is assumed that the 
state vector x(n) can be directly measured, and the control u(n) is adjusted 
based on this information. Consider the (open-loop) time-invariant control 
system shown in Figure 10.11, whose equation is 


x(n +1) = Ax(n) + Bu(n), (10.4.1) 


where, as before, A is a k x k matrix and Bak x m matrix. 

Suppose we apply linear feedback u(n) = —Ka(n), where K is a real 
m x k matrix called the state feedback or gain state matrix. The resulting 
(closed-loop) system (Figure 10.12) obtained by substituting u = —K z into 
(10.4.1) is 


x(n +1) = Ax(n) — BKa(n), 
or 


a(n+1) =(A- BK)z(n). (10.4.2) 


x(n+1) 


FIGURE 10.12. Closed-loop system. 
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The objective of feedback control is to choose K in such a way such that the 
resulting system (10.4.2) behaves in a prespecified manner. For example, 
if one wishes to stabilize system (10.4.1), that is, to make its zero solution 
asymptotically stable, K must be chosen so that all the eigenvalues of 
A — BK lie inside the unit disk. 

We now give the main result in this section. 


Theorem 10.19. Let A = {u1, fo,..., Hk} be an arbitrary set of k com- 
plex numbers such that A = {ji1, ji2,..., fix} = A. Then the pair {A, B} is 
completely controllable if and only if there exists a matrix K such that the 
eigenvalues of A— BK are the set A. 


Since the proof of the theorem is rather lengthy, we first present the 
proof for the case m = 1, i.e., when B is a k x 1 vector and u(n) is 
a scalar. We start the proof by writing the characteristic polynomial of 
A, |A — AT] = AF + ay AFT} + agdAP-2 +--+ + ay. Suppose also that 

k 

[[Q = ui) = AF + DAE + Doh? $$ dp. 

i=1 
Define T = WM, where W is the controllability matrix of rank k defined 
in (10.2.1) as 


W =(B,AB,...,A*—1B) 


and 
Ap-1 Gp-9 .-. Gy 
ak—-2 Ak-3 1 0 
M= 
ay 1 0 0 
1 0 0 0 
Then (Exercises 10.4, Problem 12) 
0 1 0 0 
0 0 1 0 
AZT VAL S\|' : (10.4.3) 
0 0 0 1 
ak Qk-1 ûk—2 ay 
and 
B=T'B=(0 0 - 0 1)’. 


Letting x(n) = TZ(n) in system (10.4.2), we get the equivalent system 
z(n +1) =(A-— BK)z(n), (10.4.4) 
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where 
K = KT. (10.4.5) 
Choose 
K = (bk — ak, bk-1 — Qp_1,...,01 — 1). (10.4.6) 
Then 
0 oe 0 
0 ise 0 
0 0 wes 0 
bk — akp bk-1— akı bı — ay 


Observe that A— BK is similar to A— BK, since A— BK = THAT — 
T-1BKT =T-1(A— BK)T. Thus 


1 0 
0 À 0 

JI-A+BK|=|AI-A+BK|=| : ; 
0 Oon’ 1 
—by —bk-1 ... AÀA—bı 


= AF + bi AFTI +--+ bp, 


which has A as its set of eigenvalues. Hence the required feedback (gain) 
matrix is given by 


K = KT! = (bk — Qk, bk—-1 — @k—1; ---, b1 — ai) TTE. 
Example 10.20. Consider the control system z(n + 1) = Ax(n) + Bu(n) 


with 
1 -3 1 
A= , B= . 


Find a state feedback gain matrix K such that the eigenvalues of the closed 
loop system are $ and 4. 


Solution 


Method 1 


So 


460 10. Control Theory 


Also 
1 1 gye a 1 
— >- —-] =A- = 10.4.7 
(a z) ( z) eee (10.4.7) 
So 
bi = —-— and bg = x. 
Now, 
1 —2 —3 1 
W = , M= 
DERD 
Hence 
1 —2 —3 1 —5 1 
T=WM= = 
a a 
and 
pact 1 -l 
8\-3 —5 
Therefore, 
K => (b2 = az, by = ar, 
or 


if 1 1 1 -1 165 —21 
K = é = — —— g 
( 135 27) ( 5) k = ( 64 64 ) 
Method 2 In this method we substitute K = (kık2) into the characteristic 


polynomial |A — BK — Al| and then match the coefficients of powers in A 
with the desired characteristic polynomial (10.4.7). 


Cheon. Sok 
A= hi 2h = 


= X? — A(3 — kı — k2) + 14 — 5kı + 3k2. (10.4.8) 


Comparing the coefficients of powers in À in (10.4.7) and (10.4.8), we obtain 


3 
3—ky — ko = T 
1 
This gives us kı = +2? and kz = =. 


Hence 


a 
64 64 
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To prove the general case m > 1 of Theorem 10.19 we need the following 
preliminary result. 


Lemma 10.21. If the pair {A,B} is completely controllable and the 
columns of B, assumed nonzero, are b1,b2, ..., bm, then there exist ma- 
trices K;,1 < i < m, such that the pairs {A — BK;,b;} are completely 
controllable. 


PROOF. Let us consider the case 7 = 1. Since the controllability matrix W 
has rank k (full rank), one may select a basis of R? consisting of k columns 
of W. One such selection would be the k x k matrix 


M= (b1, Abi, wee ,A™—1b,, b2, Abo, wee a"? tbo, as .) ; 


where r; is the smallest integer such that Ab; is linearly dependent 
on all the preceding vectors. Define an m x k matrix L having its rith 
column equal to e> = (0,1,...,0)7, its (rı + rg)th column equal to 
ez = (0,0,1,...,0)”, and so on, all its other columns being zero. We claim 
that the desired matrix K; is given by Kı = LM~!. To verify the claim, we 
compare the corresponding columns on both sides of Kı M = L. It follows 
immediately that 


Kıbı = 0, K, Ab, =0,..., K1 A" !b] = eo, 
Kıbz = 0, KıAb = 0,..., K1 A"? 1b = e3, 
Kıb3 = 0, etc. 


Thus we have 
(b1, (A — BK:)bı, (A — BK2)°b1,..., (A — BK2)*~*b1) = W (k), 


which has rank k by assumption. This proves our claim. We are now ready 
to give the proof of the general case m > 1 in Theorem 10.19. 


PROOF OF THEOREM 10.19. Let Kı be the matrix in Lemma 10.21. 
Then by Lemma 10.21, it follows that the pair {A— BK}, bı} is completely 
controllable. And by the proof of Lemma 10.21 for m = 1, there exists a 
1 x k vector € such that the eigenvalues of A + BK, + b£ are the set A. 
Let K be the m x k matrix whose first row is € and all other rows are zero. 
Then the desired feedback (gain) matrix is given by K = Kı + K. Since 
u = — Krz, this gives 


z(n +1) = (A -— BR)a(n) = (A — BK: — bi$)a(n). 


To prove the converse, select Ko such that (A — BKo)” > 0 as n > 
oo, that is, the spectral radius p(A — BK,) is less than 1, and select Kı 
such that p(A — Bk,) = {exp (252) :n=0,1,...,k— 1}, the kth roots 
of unity. Then clearly, (A — BK,)* = 1. Suppose that for some vector 
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£ € R*,€7A"B =0 for all n € Z+. Then for any matrix K, 
¿T (A — BK)" = €7(A-— BK)(A— BK)" 
= (€7A-€*BK)(A- BK)" 
= &?A(A—BK)""! (since ¿TB = 0) 
= ¿T A(A — BK)(A-— BK)"~? 
= &7A?(A— BK)" (since €7 AB = 0). 
Continuing this procedure we obtain 
é7(A— BK)" =€'A", forallneZ*. 
This implies that 
é7|(A — BK,)" — (A— BK,)"|=0, forallneZ*, 


é7|(A— BK,)*" —1]=0, forallre Zt. 


Letting r — œœ, we have (A — BKo)*” — 0 and, consequently, ¿f = 0. 
This implies that the pair {A, B} is completely controllable. 


An immediate consequence of Theorem 10.19 is a simple sufficient condi- 
tion for stabilizability. A system x(n +1) = Ax(n) + Bu(n) is stabilizable if 
one can find a feedback control u(n) = —K a(n) such that the zero solution 
of the resulting closed-loop system a(n + 1) = (A — BK)z(n) is asymp- 
totically stable. In other words, the pair {A, B} is stabilizable if for some 
matrix K, A — BK is a stable matrix (i.e., all its eigenvalues lie inside the 
unit disk). 


Corollary 10.22. System (10.4.1) is stabilizable if it is completely 
controllable. 


The question still remains whether or not we can stabilize an uncontrol- 
lable system. The answer is yes and no, as may be seen by the following 
example. 


Example 10.23. Consider the control system 
x(n +1) = Ax(n) + Bu(n), 


where 
0 a b 1 6 
A=|1 de], B=|0 @ 
0 0 h 0 0 


Let us write 
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where 
0 a b 1 py 
Au = , Ap= , Av=(h), B= ; 
11 f i 12 (') 22 = (h) 1 l ) 
fzr = 0) , then our system may be written as 
z 


y(n +1) = Any(n) + Ai2z(n) + Biu(n), 
z(n +1) = Ago2(n). 


It is easy to verify that the pair {A,,, By} is completely controllable. Hence 
by Theorem 10.19, there is a 2 x 2 gain matrix K such that A11 + B,K is 
a stable matrix. Letting K = (K)(0), then 


Aj ag BK J 


A- BK = 
( 0 h 


Hence the matrix A — BK is stable if and only if |A| < 1. 

In the general case, a system is stabilizable if and only if the uncon- 
trollable part is asymptotically stable (Exercises 10.4, Problem 8). In this 
instance, from the columns of the controllability matrix W we select a basis 
for the controllable part of the system and extend it to a basis S for RF. 
The change of variables x = Py, where P is the matrix whose columns are 
the elements of S, transforms our system to 


y(n +1) = Ay(n) + Bu, 


Bs Ay, A -= B 
g- [n 4r BE 1h. 
0 Ags 0 


Here the pair {411, Bı} is controllable. Hence the system is stabilizable if 
and only if the matrix Ago is stable. 


where 


10.4.1 Stabilization of Nonlinear Systems by Feedback 


Before ending this section, let us turn our attention to the problem of 
stabilizing a nonlinear system 


x(n +1) = f(#(n),u(n)), (10.4.9) 
where f: RE x R™ — RF. The objective is to find a feedback control 
u(n) = h(a(n)) (10.4.10) 


in such a way that the equilibrium point x* = 0 of the closed-loop system 


a(n+1)=f(a(n)), h(x(n)), (10.4.11) 
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is asymptotically stable (locally!). We make the following assumptions: 
(i) f(0,0) =0, and 
(ii) f is continuously differentiable, A = 2 (0,0) isa k x k matrix, B = 
2E (o, 0) is a k x m matrix. 
Under the above conditions, we have the following surprising result. 
Theorem 10.24. If the pair {A,B} is controllable, then the nonlinear 
system (10.4.9) is stabilizable. Moreover, if K is the gain matrix for the 


pair {A,B}, then the control u(n) = —Ka(n) may be used to stabilize 
system (10.4.9). 


PROOF. Since the pair {A,B} is controllable, there exists a feedback 
control u(n) = —Ka(n) that stabilizes the linear part of the system, 
namely, 


y(n + 1) = Ay(n) + Bu(n). 


We are going to use the same control on the nonlinear system. So let 
g: RE — R" be a function defined by g(x) = f(x,-Kzax). Then system 
equation (10.4.9) becomes 


x(n + 1) = g(a(n)) (10.4.12) 
with 

CO) GASER 

OF | p25 


Since by assumption the zero solution of the linearized system 
y(n+1) = (A- BK )y(n) (10.4.13) 


is asymptotically stable, it follows by Theorem 4.20 that the zero solution 
of system (10.4.12) is also asymptotically stable. This completes the proof 
of the theorem. 


Example 10.25. Consider the nonlinear difference system 


zın +1) = 2sin(a1(n)) + z2 + u(n), 


xo(n +1) = z? (n) — x(n) — u(n). 
Find a control that stabilizes the system. 


Solution One may check easily the controllability of the linearized system 


{A, B}, where 
2 1 1 
A m 3 B= , 
0 —1 —1 


after some computation. A gain matrix for the linearized system is K = 
(2.015, 0.975), where the eigenvalues of A— BK are 4 and 0.1. As implied by 
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Theorem 10.24, the control u(n) = —Ka(n) would stabilize the nonlinear 
system, where K = (2.015, 0.975). 


Exercises 10.4 


In Problems 1 through 3 determine the gain matrix K that stabilizes the 
system {A, B}. 


1 


*8, 


0 1 
. A= 
er z 


2 1 
.A=|]-2 1 
—2 -1 0 —2 
0 
0 
1 


0 
1 
0 


. Determine the matrices B for which the system {A,B}, A = 


1 -l 2 

1 
0 z 1] is (a) controllable and (b) stabilizable. 
1 =o 


a eee) 
2 2 


. Consider the second-order equation 


x(n + 2) + aya(n + 1) + aga(n) = u(n). 


Determine a gain control u(n) = cya(n) + c2x(n + 1) that stabilizes 
the equation. 


. Describe an algorithm for decomposing the system z(n+1) = Aa(n)+ 


Bu(n) into its controllable and uncontrollable parts when A is a 3 x 3 
matrix and B is a 3 x 2 matrix. 


. Generalize the result of Problem 6 to the case where A isa kx k matrix 


and B is a k x r matrix. 


Show that the pair {A, B} is stabilizable if and only if the uncontrol- 
lable part of the system is asymptotically stable. 


. Deadbeat Response. If the eigenvalues of the matrix A — BK are all 


zero, then the solutions of the system a(n + 1) = (A — BK)z(n) will 
read 0 in finite time. It is then said that the gain matrix K produces 
a deadbeat response. Suppose that A is a 3 x 3 matrix and Ba3 x1 
vector. 
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11. 


12. 
13. 


14. 


15. 
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(a) Show that the desired feedback matrix K for the deadbeat 
response is given by 


K=[1 0 Of & &]-, 


where 
& =A ‘B, &=(A')B, &=(A™)*B. 
(b) Show that the vectors £1, £2, and €3 are generalized eigenvectors 
of the matrix A — BK |ie., (A — BK) = 0,(A — BK): = 
£1, (A— BK )&3 = &]. 


Ackermann’s Formula: 

Let A = {11, H2,- - . , Hk} be the desired eigenvalues for the completely 
controllable pair {A,B}, with A = A. Show that the feedback (gain) 
matrix K can be given by 


1 


K=(0 0 -> 0)(B AB >- AIB) p(A), 


where 
k 


i=1 


Let A = {;1, u2,..-, Hk} be a set of complex numbers with A = A. 
Show that if the pair {A, C} is completely observable, then there exists 
a matrix L such that the eigenvalues of A — LC are the set A. 


Verify formula (10.4.3). 
Find a stabilizing control for the system 
x1(n +1) = 321(n) + #3 (n) — sat(2x2(n) + u(n)), 


to(n+ 1) =sin x(n) — xo(n) + u(n), 


where 
y if [y| < 1, 
sat y = 
sign y if |y| >1. 
Find a stabilizing control for the system 
ri(n +1) = 2z (n) + za(n) + z3 (n) + u(n) + 2u2(n), 


ro(n+1) = zf? (n) + sin x(n) + z2(n) + u? (n) + u2(n), 


x3(n +1) = xi(n) + 23(n) + sean) + u(n). 


(Research problem). Find sufficient conditions for the stabilizability of 
a time-variant system 


x(n +1) = A(n)a(n) + B(n)u(n). 
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16. (Research problem). Extend the result of Problem 15 to nonlinear 
time-variant systems. 


10.5 Observers 


Theorem 10.19 provides a method of finding a control u(n) = —Ka(n) 
that stabilizes a given system. This method clearly requires the knowledge 
of all state variables x(n). Unfortunately, in many systems of practical 
importance, the entire state vector is not available for measurement. Faced 
with this difficulty, we are led to construct an estimate of the full state 
vector based on the available measurements. Let us consider again the 
system 
x(n +1) = Ax(n) + Bu(n), 
y(n) = Ca(n). (10.5.1) 


To estimate the state vector x(n) we construct the k-dimensional observer 
(Figure 10.13) 


z(n+1) = Az(n) + Ely(n) — Cz(n)] + Bu(n), (10.5.2) 


where E is a k x r matrix to be determined later. Notice that unlike x(n), 
the state observer z(n) can be obtained from available data. To see this, 
let us write the observer (10.5.2) in the form 


z(n+1) = (A- EC)z(n) + Ey(n) + Bu(n). (10.5.3) 


We observe here that the inputs to the observer involve y(n) and u(n), 
which are available to us. 

The question remains whether the observer state z(n) is a good estimate 
of the original state x(n). One way to check the goodness of this estimator 
is to ensure that the error e(n) = z(n) — x(n) goes to zero as n —> co. To 
achieve this objective we write the error equation in e(n) by subtracting 
(10.5.2) from (10.5.1) and using y(n) = Ca(n). Hence 


z(n+1)—a(n+1) = [A — EC][z(n) — x(n)], 


FIGURE 10.13. Observer. 


468 10. Control Theory 


e(n +1) = [A — ECle(n). (10.5.4) 


Clearly, if the zero solution of system (10.5.4) is asymptotically stable 
(i.e., the matrix A — EC is stable), then the error vector e(n) tends to 
zero. Thus the problem reduces to finding a matrix E such that the matrix 
A — EC has all its eigenvalues inside the unit disk. The following result 
gives a condition under which this can be done. 


Theorem 10.26. If system (10.5.1) is completely observable, then an 
observer (10.5.2) can be constructed such that the eigenvalues of the matrix 
A-— EC are arbitrarily chosen. In particular, one can choose a matrix E 
such that the error e(n) = z(n) — x(n) in the estimate of the state x(n) by 
the state observer z(n) tends to zero. 


PROOF. Since the pair {A,C} is completely observable, it follows from 
Section 4.3 that the pair {AT, OT} is completely controllable. Hence by 
Theorem 10.19 the matrix E can be chosen such that AT — CTET has an 
arbitrary set of eigenvalues, which is the same as the set of eigenvalues of 
the matrix A — EC. 

Moreover, if we choose the matrix E such that all the eigenvalues of 
the matrix A — EC are inside the unit disk, then e(n) — 0 (see Corollary 
3.24). 


10.5.1 Eigenvalue Separation Theorem 
Suppose that the system 
x(n + 1) = Az(n) + Bu(n), 
y(n) = Cx(n), 


is both completely observable and completely controllable. Assuming that 
the state vector x(n) is available, we can use Theorem 10.24 to find a 
feedback control u(n) = —Ka(n) such that in the closed-loop system 


a(n+1) = (A- BK)zr(n) 


the eigenvalues of A— BK can be chosen arbitrarily. Next we use Theorem 
10.26 to choose a state observer z(n) to estimate the state x(n) in such a 
way that the eigenvalues of A — EC in the observer 


z(n+1) = (A- EC)z(n) + Ey(n) + Bu(n) 


can also be chosen arbitrarily. 

In practice, a feedback control may be obtained using the state ob- 
server z(n) instead of the original state z(n) (whose components are not 
all available for measurement). In other words, we use the feedback control 


u(n) = —K2(n). (10.5.5) 
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The resulting composite system is given by 


x(n +1) = Aa(n) — BKz(n), 
z(n+1) = (A- EC)z(n) + ECa(n) — BKz(n). 


It follows that 
e(n+ 1) = 2(n+ 1) —a2(n4+1) = (A — EC)e(n). 


Hence we have the following composite system: 


a(n+1)=(A- BK)a(n) + BKe(n), 
e(n +1) = (A — EC)e(n). 


The system matrix is given by 
A A- BK BK 
7 0 A-EC}’ 


whose characteristic polynomial is the product of the characteristic poly- 
nomials of (A — BK) and (A — EC). Hence the eigenvalues of A are either 
eigenvalues of A — BK or eigenvalues of A — EC, which we can choose 
arbitrarily. Thus we have proved the following result. 


Theorem 10.27 (Eigenvalue Separation Theorem). Consider the 
system 


a(n+1) = Az(n) + Bu(n), 


with the observer 
2(n+1) = (A— EC)2(n) + Ey(n) + Bu(n) 
and the feedback control 
u(n) = —K2(n). 


Then the characteristic polynomial of this composite system is the product 
of the characteristic polynomials of A— BK and A — EC. Furthermore, 
the eigenvalues of the composite system can be chosen arbitrarily. 


Example 10.28. Consider the system 
a(n +1) = Ax(n) + Bu(n), 
y(n) = Ca(n), 


where 
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Design a state observer so that the eigenvalues of the observer matrix A — 
EC are $+ $i and 4 — i. 


Solution The observability matrix is given by 


(4) = (0 a) 


which has full rank 2. Thus the system is completely observable, and the 

desired observer feedback gain matrix EF may be now determined. The 

characteristic equation of the observer is given by det(A — EC — XI) = 0. 
If 


then we have 


which reduces to 


M+ (1+ A)A+ EF, + —=0. (10.5.6) 


By assumption the desired characteristic equation is given by 


1 1, 1 O 
( 5 zi) Q 3+3) = 0, 


or 
1 
X —A++ 5 = 0. (10.5.7) 
Comparing (10.5.6) and (10.5.7) yields 
1 
Ey = T E = —2. 
1 
Thus E = 4 


—2 


Example 10.29. Figure 10.14 shows a metallic sphere of mass m sus- 
pended in a magnetic field generated by an electromagnet. The equation 
of motion for this system is 
2 
ML, = mg — kot, 


(10.5.8) 


Tt 
where x, is the distance of the sphere from the magnet, us is the cur- 
rent driving the electromagnet, g is the acceleration of gravity, and k is a 
constant determined by the properties of the magnet. 
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OF 


TE © 


FIGURE 10.14. A metallic sphere suspended in a magnetic field. 


It is easy to check that (10.5.8) has an equilibrium at 


t=%=1, 


ut = uo = Ving /k. 


Linearizing (10.5.8) about this equilibrium gives the following approximate 
model in terms of the deviations x = £4 — £o and u = ut — Uo: 


£- ae = -2/kg/mu, 


or, in state variable form, 


wn 0 1) [x A 0 
— u 
Ù A O} Ju —2\/kg/m 
Thus 
» fO 1 0 
A= ; = . 
: 0 —2y4 kg/m 


The matrix Â can be written in the form 
Â= PAPH, 


where 
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So 
cosh Ir Ti Ir 
A= eT c k g k 
Z sinh A cosh Ai 
: Vk/msinh jer 
B=Te*?B=-2T 
g/mcosh 5 


The discrete equivalent system is thus controllable, since 


det W = ||B_ AB]| 
sinh jer 2 sinh jer cosh y/ 27 
= |-2T 
"g sinh [2 T 24/2 sin nJ $T cosh jor 


= cef br sinh [or 


where c= 0 only if T = 0. 
If the position deviation x of the ball from equilibrium can be measured, 
then the system is also observable, since then we have the measurement 


equation 
x 


C=[1 o. 


ae 


and hence 


Observability is easily verified by on 


cosh z i sinh T 
k 
= Fn jer 


which is zero only if T = 0. Before continuing, fix m = k = 0.1,g = 10, 
and T = 0.01. Thus 


det V = 


1.0017 1.0050 —0.2010 


1.0050 dl 7 et 
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Note that A is unstable, with eigenvalues A; = 1.1052 and Az = 0.9048. 

Controllability of {A, B} implies that a stabilizing state feedback gain 
K = |kı, k2] can be found. Moreover, the eigenvalues of the resulting system 
matrix A— BK can be assigned arbitrarily. In our example, 


1.0050 + 0.0020k; 0.0100 + 0.0020k2 
1.00017 + 0.2010k; 1.0050 + 0.2010k2 


A-Bk= 


so that 
AZ- A+ BK|= yo (2.0100 + 0.002kı + 0.201k2)A + 0.2000k2 + 1, 


and eigenvalues \; = 5 and Az = —4 (both inside the unit circle) can be 


2 
obtained by choosing 
K = [ky, ke] = [-376.2492 — 6.2500). 


Observability of {A,C} implies that an asymptotic observer can be 
constructed to produce an estimate of the system state vector from mea- 
surements of x. The observer gain L = [l,l2]7 can be chosen not only 
to ensure that the state estimate converges, but to place the observer 
eigenvalues arbitrarily. In our example, 

1.0050 — 1; al 


A-LC= 
1.0017 — lə 1.0050 


so that 
|AL-A+LC| = A? + +(4 - oe — 1.00501, + 0.0100/2 + 1, 


and eigenvalues A; = 3 + and Ag = —3 can be obtained by choosing 


_ [li] | 2.0100 
~ {Ig} | 95.5973] ° 


The eigenvalue separation theorem ensures that combining this observer 
with the state feedback controller doped above will produce a stable 


closed-loop system with eigenvalues +5 I and i. 


Exercises 10.5 


In Problems 1 through 4 design an observer so that the eigenvalues of the 
matrix A— EC are as given. 


nash = C=(1 1), 
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1 0 0 
.A=|0 01], C=(0 1 0), 
0 1 0 
M = 5 2 =4-F4, à= G+ Fi 
: 1 0 ee 
eee care! 
1 0 1 
0 0 -i 
`=, AX=-4, Msi. 


. (Reduced-Order Observers): 


Consider the completely observable system 
x(n +1) = Ax(n) + Bu(n), 
y(n) = Ca(n), (10.5.9) 


where it is assumed that the r x k matrix C has rank r (i.e., the r 
measurements are linearly independent). Let H be a (k—r) x k matrix 
such that the matrix 


is nonsingular. Let 
Z(n) = Pa(n). (10.5.10) 


Then Z may be written as 


where w(n) is (k — r)-dimensional and y(n) is the r-dimensional vector 
of outputs. 


(a) Use (10.5.10) to show that system equation (10.5.9) may be put 
in the form 


w(n+ 1) Š, Ai Aj w(n) Bı a 
ean) E & i) oH i P Cao 
(b) Multiply the bottom part of (10.5.11) by any (k — r) x r matrix 
E to show that 
W(n +1) — Ey(n +1) = (Au — EA21)[W (n) — Ey(n)] 


+ [41E — EA23 E + Aye — E Aə2ļy(n) 
+ (Bı — EBz)u(n). 
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(c) If v(n) = w(n) — Fy(n), show that 

v(n + 1) = (A11 — EAa1)v(n) 
+ [41E — EAn E + Ai — EAgoly(n) 
or (Bı — FBəju(n). 


(d) Explain why we can take an observer of system equation (10.5.9) 
as the (k — r)-dimensional system 
z(n + 1) = (Ai ari EApo1)z(n) 
= [AE = EA» E + Aj = EA22| y(n) 


+ (By — FBp)u(n). (10.5.12) 
(e) Let e(n) = z(n) — v(n). Show that 


6. Prove that if the system equation (10.5.9) is completely observable, 
then the pair {A11, A21 } in (10.5.11) is completely observable. 


7. Prove the eigenvalue separation theorem, Theorem 10.27, for reduced- 
order observers. 


8. Consider the system 
zı(n + 1) = z2(n), 
gza(n + 1) = =x (n) + 2xz2(n) + u(n), 
y(n) = xı (n). 


Construct a one-dimensional observer with a zero eigenvalue. 


Appendix A 


Stability of Nonhyperbolic Fixed 
Points of Maps on the Real Line 


A.1 Local Stability of Nonoscillatory 
Nonhyperbolic Maps 


Our aim in this appendix is to extend Theorems 1.15 and 1.16 to cover 
all the remaining unresolved cases. The exposition is based on the recent 
paper by Dannan, Elaydi and Ponomarenko [30]. The main tools used here 
are the Intermediate Value Theorem and Taylor’s Theorem which we are 
going to state. 


Theorem A.1 (The Intermediate Value Theorem). Let f be a con- 
tinuous function on an interval I = [a,b] such that f(a) # f(b). If c is 
between f(a) and f(b), then there exists xo € (a,b) such that f(x9) = c. 
In particular, if f(a) and f(b) are of opposite sign, then since 0 is between 
f(a) and f(b), there exists xo between a and b such that f(ao) = 0. 


Theorem A.2 (Taylor’s Theorem). Suppose that the (n+1)th deriva- 
tive of the function f exists on an interval containing the points a and b. 
Then 


f(a) 


F(0) = Fla) + F(a(o— a) + FL oa? + Fa)? 
(a (ntl) 
settee | ) b- a)” aE b— aj”! (A.1.1) 


for some number z between a and b. 
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Notation: The notation of f € C” means that the derivatives f’, f”,..., fO 
exist and are continuous. 


Theorem A.3. Let x* be a fixed point of f, then the following statements 
hold true: 


(i) Suppose that f € C?*. If f'(x*) = 1, and f"(a*) =--- = fP*-D(a2*) = 
0 but f°?) (x*) A 0, then x* is semi-asymptotically stable: 


(a) from the left if f°") (x*) > 0, and 
(b) from the right if f2")(x*) <0. 


(ii) Suppose that f € C@*+), If fi(x*) = 1, and f"(a*) = --- = 
FCM (a*) = 0 but FORTY (a*) £0, then: 


(a) x* is asymptotically stable if f?*+)(2*) <0, and 
(b) 2* is unstable if fP*+)(2*) > 0. 
PROOF. 
(i) Assume that f’(2*) = 1, f’(a*) = =- = fP*-V(2*) = 0 but 
Jha) £0. 
(a) If fC) (x*) > 0, then by Taylor’s Theorem, for a sufficiently small 
number 6 > 0, we have 
f(a" +6) = fla") + FP @*)6 +... 
FOR Va gad) f°") (€)62* 
i (2k — 1)! ' (2k)! 


(A.1.2) 


for some € € (x*, x* +ô). If 6 is sufficiently small, we may conclude 
that FCP (£) > 0. Substituting in (A.1.2) yields 


(2k) 62k 
f(z* +6) =2*+64 j ag i (A.1.3) 
Similarly one may show that 
(2k) §2k 
f(a* —6) =a" —64 j E: ; (A.1.4) 


Hence from (A.1.3), it follows that f(a* +6) > a* +6. And from 
(A.1.4) we have «* — 6 < f(x* — ô) < a*. This proves semi- 
asymptotic stability from the left. 


(b) The proof of part (b) is analogous and will be left to the reader. 
(ii) By the assumptions in (ii) we have, for some 6 > 0, 


forty (€)624+1 


f(a*+6)=a*4+64+ ok + D)! 


(A.1.5) 
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for some € € (a*,a* + ô). 
Furthermore, 


: = ; fet) (e)2h1 
S ae S E a 


(a) If FCFTD(z*) < 0, then, from (A.1.5), f(£*+8) < z* +ô and, from 
(A.1.6), f(x* — 6) > x* — 6. Hence x* is asymptotically stable. 


(A.1.6) 


(b) The proof of part (b) is analagous and will be left to the reader. 


Consider the map f(x) = x + (x — 1)*, where z* = 1 is a fixed point of 
f with f'(z*)=1, f”’(a*) = f" (x*) = 0, and f (x*) = 24 > 0. Then by 
Theorem A.3, x* is semi-asymptotically stable from the left. 


A.2 Local Stability of Oscillatory 
Nonhyperbolic Maps 


We now consider the case when f’(x*) = —1. A nice trick here is to look 


at the map g(x) = f(f(x)) = f? (2). 


A.2.1 Results with g(x) 


Since 2* is a fixed point of f, it must be a fixed point of g and g/(a*) = 1. 
Moreover, g”(x*) = 0 and g” (x*) = 2S f(x*). Notice that z* is asymptot- 
ically stable {unstable} under g if, and only if, it is asymptotically stable 
{unstable} under f. This is due to the fact that |f"(x*)| < 1 if and only if 
Ig"(a*)| <1. 

We can then apply the second half of Theorem A.3 to get the following 
result. 


Theorem A.4. Suppose that f € C2**+) and x* is a fixed point of f such 
that f'(a*) = —1. If g’(a*) = ... = g2@%(z*) = 0 and g?**)(a*) Æ 0, 
then: 

(1) x* is asymptotically stable if g?*+)(a2*) <0, and 

(2) 2* is unstable if g@*+) (a*) > 0. 

Observe that this strategy does not use the other part of Theorem A.3— 
where x* is semi-asymptotically stable under g. That is, the case where 
fiat) =—1, g! (at) =... = gD (a*) = 0, and g?*)(2*) £0. 

We now argue that this situation will never occur for analytic f. 
Theorem A.5. Let f be analytic with f'(x*) = —1. Then, for some k > 1, 


(1) Fo! @*) =... = 92" Yat) = 0, then gC» (z*) = 0. 
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(2) x* cannot be semi-asymptotically stable under g. 


PROOF. By Taylor’s Theorem, we have some small ô with 


8f” (x* 
fle" +8) = fle") +6f e+ LE, 
= 2* —§+0(8). 


Hence, for x9 = x* +6 > x*, we have f(a) < 2* and for zo = 2*—46 < a", 
we have f(a) > x*. In other words, for xo € (a* — 6, x* + 6) either 
fE (a*) © (a*, 2* +5) and f2**!(x*) e (2* — ô, x*) for all k € Zt or 
f2(a*) € (x* — 6, x*) and f?**1(2*) € (2*, x* +ô) for all k € Z+. 

Now, if f?*(a9) > 2* as k > oo, then f?*+1(29) > x* as k — oo. Hence 
either x* is asymptotically stable or x* is unstable and, more importantly, 
it cannot be semi-asymptotically stable. 


These results using g(x) are conclusive but not entirely satisfactory. For 
example, we return to f(x) = —x + 2x? — 4x. To determine the stability 
of f(x) at 0, we need to find derivatives of g(x) = —x + 4r? — 8x3 4 
642° — 192z + 38427 — 38428 + 256x°. It turns out that g°(0) = 7680; 
hence, by Theorem A.4, 0 is an unstable fixed point. However, this was 
computationally difficult, and we would like an analogue of Theorem A.4 
using only the derivatives of f(x). 


Remark: If f'(z*) = 1, f(a*) = 0 for all k > 1, and f is analytic, 
then f(x) = x. Consequently, every point in the vicinity of 2* is a fixed 
point and 2* is thus stable but not asymptotically stable. If f’(a*) = —1, 
g*)(x*) = 0 for all k > 1, and if f is analytic, then g(x) = x. Hence every 
point in the vicinity of x* is periodic of period 2, and 2* is again stable but 
not asymptotically stable. 


Example A.6. Consider the maps fi (x) = ate", fo (x) = rtre, 
fs(£) = r—ze™®”, with f;(0) = 0. Each of these maps has f/(0) = —1, and 
f(0) = 0 for all k > 1. However, the fixed point 0 is semi-asymptotically 
stable from the left, unstable, and asymptotically stable, respectively. 


Example A.7. Contemplate May’s genotype selection model 


z(n)er—2#(n)) 
J — 
x(n + ) 1 x(n) + z(nje20=22(n)) oy 
At the fixed point 2* = 3, f'(a*) = 1—§. The fixed point is thus asymptoti- 
cally stable for 1 < a < 4 by Theorem 1.13. At a = 4, we have f’(2*) = —1, 
g” (a*) = g” (*) = 0, but g’’(a*) = —32 < 0. Hence by Theorem A.4, the 
fixed point 2* = 4 is asymptotically stable. 


a>0, weé€(0,1). (A.2.1) 


Appendix B 
The Vandermonde Matrix 


The generalized Vandermonde matrix is given by 


1 0 we 0 
ài 1 a A 1 ae 

ae ài 2X1 ma De 2d. iik (B.1) 
ASL ENS g AEE eae? 


and consists of k x m; submatrices corresponding to the eigenvalues ,, 
1 <i <r, Ď;mi = k. The first column in the k x mı subma- 
trix is c = (1, à1,A?,..., AÏ), the second column is c2 = $c} (à) = 
(0,1,241,3A7,...,KAE1)7, ..., the sth column is cs = ghyel* (A1), 
where EA) is the mth derivative of column cı. The extension of this 
definition to other k x m; submatrices is done in the natural way. We are 
now going to prove the following result. 


Lemma B.1 [76]. 


W(0)=detV= |] A; ae. (B.2) 
1<i<j<k 


Moreover, V is invertible. 


ProoF. The proof proceeds by induction on the sum of multiplicities m; 
of the eigenvalues A;, with m; > 1. If all the m,’s are equal to 1, we have the 
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regular Vandermonde matrix (2.3.3) and thus (B.2) holds. For the example 
my, = 3, Mm = 2 (Ay = Ag = A3, A4 = As), the sum of multiplicities which 
exceed 1 is 3+ 2 = 5. To illustrate the induction step, let 

1 0 1 1 0 
Aà 1 t à 1 
W=|d\? 2h, Ê AZ 2). 
Ne a ORT BN 
AT OE a Ae Ae 


So that the sum of multiplicities greater than 1 is 4. 
Assuming (B.2) for W yields 


Way) Oe = 1) 08 =a: 


Note that 
1/\> 
WO) Fa le 
1 ad 2 2 
= 502- At BE- Ar) 2 = #)? = 2(¢ = à)? Aa- t) ee 


Il 


(Ms — A BOA- t)? — A(t — Ar) (A2 t) 
— A(t — Ay) (Ag — t) + 2(t — 1)? 
Sie ae. 


pen 


In general, W (0) is formed from W as long as there is one multiplicity 
m; > 1. The general case may be proved in an analogous manner. 


Appendix C 
Stability of Nondifferentiable Maps 


The main objective of this appendix is to prove Theorem 4.8. In fact, we 
will prove a more general result which appeared in Elaydi and Sacker [50]. 
In the sequel we will assume that the f : J — I is continuous on the closed 
and bounded interval I = [a,b]. Clearly if J = [a,oo), and f is bounded and 
continuous, f(I) c J C I, where J is a closed and bounded interval, then 
f: J — J. The following lemma and its corollary are immediate sequences 
of the Intermediate Value Theorem. 


Lemma C.1. Let J = [c,d] C [a,b] such that either: 
(i) f(c) >c and f(d) < d, or 

(ii) f(c) <c and f(d) >d. 

Then f has a fixed point (c,d). 

PROOF. 


(i) Assume that f(c) > cand f(d) < d. Then for the map g(x) = f(x)—z, 
g(c) > 0 and g(d) < 0. Hence by the Intermediate Value Theorem, 
there exists x* between c and d such that g(x*) = 0. Hence f(a*) = 2*, 
and thus «* is a fixed point of f. 


The proof of (ii) is similar and will be left to the reader. 


Corollary C.2. Suppose that J = [c,d] C I. If f(d) > d and (c,d) is fixed 
point-free, then f(x) >a for all x € (c,d). 


We are now ready to present the main result. 
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Theorem C.3. Let f: I — I be continuous. Then the following 
statements are equivalent: 


(i) f has no points of minimal period 2 in (a,b). 
(ii) For all xo € (a,b), {f"(xo)} converges in I. 


PROOF. (ii) => (i). 
If {%1, £2} is a periodic orbit of period 2 in (a,b), then {f"(Z)} does not 
converge as it oscillates between gı and Zo. 


(i) => (ii) . 

Assume there exists rp € (a,b) such that {f"(2o)} does not converge. 
Thus zo is not a fixed point or an eventually fixed point. Hence its orbit 
O(%o) = {xo, £(1), x(2),... } can be partitioned into two sequences A = 
{a(k)|f(a(k)) > z(k)} and B = {ax(k)|f(a(k)) < x(k)}. Then A # @ and 
B # 0. We claim that A is strictly monotonically increasing, i.e., i < j 
implies x(t) < a(j). Assume the contrary, that there exists x(i),«(j) € A 
such that i < j but x(i) > x(j). This means that f*(zo) > f?(axo). Let 
j=i+r. Then f”(x(i)) < z(i). Since x(2) is not a fixed point of f, there 
exists a small ô > 0 such that the interval (x(i) — ô, x(i)) is free of fixed 
points. Thus we may conclude that there exists a largest fixed point z of f 
in fa, z(i)] (z may equal a). Hence the interval (z,x(2)) is fixed point-free. 
And since f(a(i)) > x(¢), it follows by Corollary C.2 that f(x) > x for all 
x E€ (z,x(i)). 

Let zn be a sequence in (z, x(i)) that converges to z. Then f(zn) > Zn 
and limpo f (2n) = f(z) = z. There exists Ny € Z* such that n > Nj, 
f(2n) € (z,2(4)). For n > Ni, f?(2n) > f(n) > z and limno f? (zn) = 
f?(2) = z. There exists No € Z* such that for n > No, f?(zn) € (z, x(4)). 
Repeating this process, there are N3, N4,..., Ny such that for n > N, 
1 <t <r, ft(zn) € (z,x(i)). For N = max{N,|1 < t < r}, ff(zn) € 
(z,x(t)), 1 < t < r. We conclude that there exists y € (z, x(i)) such that 
y, F), F7 (y) € (z,2(i)). Hence f(y) > Fily) >- > fly) >y 
But f”(x(i)) < xz(i) implies, by Lemma C.1, the existence of a fixed point 
in (y, x(i)), a contradiction which establishes our claim that A is strictly 
monotonically increasing. 

Similarly, we may show that B is strictly monotonically decreasing. De- 
fine zı = sup A, %2 = inf B. Then zı < £2 and hence neither is an end 
point. Since AU B = O(a), it follows that {%1, %2} = Q(x), the set of all 
limit points of O(xo). Since Q(xo) is invariant, either: 


(a) f(@1)= g2, f(%2) = 41, or 

(b) f(Z1)=%1, f(%2) = Ze, or 

(c) z1 = 72, 

(d) f(z1) = zı and f(z2) = zı or f(z1) = z2 and f(Z%2) = Zo. 
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Case (a) is excluded since there are no 2-cycles; cases (b) and (d) are also 
excluded since neither A nor B is invariant. Hence the only case left is case 
(c) which confirms the convergence of the sequence { f” (ao) }. 


As an immediate consequence of the preceding theorem, we have the 
following important result on global asymptotic stability. 


Corollary C.4. Let «* be a fixed point of a continuous map on the closed 
and bounded interval I = [a,b]. Then x* is globally asymptotically stable 
relative to (a,b) if and only if f?(x) > x for x < a* and f?(x) < x for 
x >a«* for all x € (a,b)\{x*}, and a,b are not periodic points. 


ProoF. The necessity is clear. To prove the sufficiency, notice that the 
given assumptions imply that there are no periodic points of minimal period 
2. Hence by Theorem C.3, {f"(xo} converges for every zo € I. Now if xo € 
(a,x*), f(£o) > xo. For, otherwise, we would have f(x0) < xo < f?(zxo), 
which implies, by the Intermediate Value Theorem, the presence of a fixed 
point of the map f in the interval (a,2*), a contradiction. Similarly, one 
may show that for all xg € (a*,b), f(ao) < vo. Thus limpo f"(%o) = c, 
where c is an interior point in the interval (a,b). Furthermore, since c is 
a fixed point of the map f, it follows that c = x*. Hence x* is globally 
attracting. 


It remains to show that x* is stable. We have two cases to consider. 


Case (i): The map f is monotonically increasing in a small neighborhood 
(a* — 6,a*). Since f(x) > x for all x € (a* — 6,2*), it follows that for 
xo € (a* — 6,x*), we have xo < f(xo) < f?(£o) <- <a". 


Case (ii): The map of f is decreasing monotonically in (x* — ô, zx). Given 
€ > 0, there exists 6 > 0, 6 < £ such that f(a* — 6) — x* < e. Furthermore, 
f(xo)—a* < efor all zo € (a*—6, x*). Since f(xo) > £o, f?(a0) < f(ao) and 
since zo < a*, f?(xo) > xo. Thus zo < f?(xo) < f(ao) and, consequently, 
f? (£o) — xz* < 6 < £. The same scenario occurs for xo > x*. Hence x* is 
stable. 


Appendix D 


Stable Manifold and the 
Hartman—Grobman-—Cushing 
Theorems 


D.1 The Stable Manifold Theorem 


Consider the nonlinear difference system 
xu(n+ 1) = f(x(n)) (D.1.1) 


such that f has a fixed point 7* € R* and f € C? in an open neighborhood 
of x*. Let A = Df(ax*) be the Jacobian of f at x*. Then (D.1.1) may be 
written in the form 


x(n +1) = Ax(n) + g(x(n). (D.1.2) 
The associated linear system is given by 
z(n +1) = Az(n). (D.1.3) 


The fixed point x* is assumed to be hyperbolic, where none of the eigen- 
values of A lie on the unit circle. Arrange the eigenvalues of A into two 
sets: S = {\1,A2,---, Ar}, G = {Ar41; s Ak} with àz < 1 fr AES 
and |A;| > 1 for A; € G. Let E° be the eigenspace spanned (gener- 
ated) by the generalized eigenvectors corresponding to S and let E” be 
the eigenspace spanned by the generalized eigenvectors corresponding to 
G. Then R! = E @ E”. The sets E° and E” are called the stable and 
unstable subspaces of x*, respectively. 

The local stable manifold of x* in an open neighborhood G defined as 


W*(a*,G) = W*(2*) = {xo € G | O(a0) C Gand lim f” (xo) = 2" }. 
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WE (x*) 


FIGURE D.1. E® is tangent to W°(2*) and E” is tangent to W“(a*). 


WE (x*) 


FIGURE D.2. Stable and unstable manifolds W*(x*) and W” (x*) in a neighbor- 
hood G of x*. 


To define the unstable manifold, we need to look at negative orbits. Since 
f is not assumed to be invertible, we have to define a principal negative 
orbit O7 (a) = {x(—n)} of a point xo as follows. We let x(0) = xo, and 
f(a(—n—1)) = x(n), n € Z*. The local unstable manifold for x* in G is 
defined to be the set 


W"(a*,G) = W"(a2*) = {ao € G | there exists a negative orbit, 
O` (zo) C Gand lim r(-n) = 2*}. 


The following theorem states that E* is tangent to W*(a*) and E” is 
tangent to W“(a*) at the fixed point 2* (see Figures D.1 and D.2). 


Theorem D.1 (The Stable Manifold Theorem). Let x* be a hyper- 

bolic fixed point of a C?-map f : RE — RE. Then in an open neighborhood 

G of x* there exist two manifolds W*(x*) of dimension E° and W“(a*) of 

dimension E” such that: 

(i) B® is tangent to W*(ax*) at x* and for any solution x(n) of (D.1.1) 
with «(0) € W5, Jim, x(n) = 2". 


(ii) E” is tangent to W"(a*) at x* and if x(0) E€ W"(a*), then there exists 
a principal negative solution x(—n) with lim x(—n) = 2*. 
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PROOF. See Cushing [24] and Robinson [128]. 


D.2 The Hartman—Grobman-—Cushing Theorem 


The Stable Manifold Theorem tells us what happens to solutions that lie 
on either the stable manifold W®* or the unstable manifold W” in a neigh- 
borhood of a hyperbolic fixed point. The question that we are going to 
address here is: What happens to solutions whose initial points do not lie 
on either W° or W”? 

The answer to this question is given by the classical Hartman—Grobman 
Theorem in differential equations and its analogue in difference equations. 
However, this theorem requires that the map is a diffeomorphism, that is 
differentiable and a homeomorphism. Two maps f : X > X andg: Y > Y 
are said to be topologically conjugate if there is a homeomorphism h : Y > 
X such that f(h(y)) = h(g(y)) for all y € Y. 


Theorem D.2 (Hartman—Grobman). Let f : Rë —> R* be a 
C” -diffeomorphism with hyperbolic fixed point x*. Then there exists neigh- 
borhoods V of «* and W of 0 and a homeomorphism h : W — V such that 
f(h(x)) = h(Ax), where A = Df (2*). 

In other words, f is topologically conjugate in a neighborhood of the fixed 
point x* to the linear map induced by the derivative at the fixed point (see 
Figure D.3). 


PROOF. See Robinson [128]. 


As pointed out in Cushing [24], this classical theorem does not hold for 
noninvertible maps, as may be seen from the following example. 


Example D.3. Consider the one-dimensional difference equation x(n + 
1) = x(n). The Jacobian at the fixed point x* = 0 is A = 0. If h is the 
conjugacy homeomorphism, then f(h(x)) = h( Ax). Then f(h(x)) = h(0) = 
0. Thus [h(x)]? = 0 and h(x) = 0 for all z € R, a contradiction, since h is 
one to one. 


Cushing [24] extended the Hartman—Grobman Theorem to noninvertible 
maps and the new result will henceforth be called HGC (Hartman— 


FIGURE D.3. f is conjugate to A = Df(«*), f(h(x)) = h(Az). 
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Grobman-—Cushing). But before stating the theorem, we need to introduce 
a few definitions. 
For a sequence x(n) € R*, let ||z||+ = sup |x(n)|, where |a(n)| is a norm 
neZt 


on R*. 
The sets 
+ = {x(n) | |la|]+ < +00}, 
Pep STAC E 
are (Banach)! spaces under the norm || - || + 
Similarly, we define 
|z|- = sup |a(n)| 
nEeZ-— 
and 
~ = {2x(n) | llzl|- < +00}, 
BSo = {2(n) € BST | lim læ(n)| = Of. 
Define 


S (0) = {x(n) € BS* | |iæll+ < ô}, 


X0) = {a(n) € BSF | llzll+ < ô} 


Theorem D.4 (Hartman-Grobman-Cushing). Suppose that x* is 
a hyperbolic fixed point of a map f € C” and let A = Df(a*) be its 
Jacobian. There exists constants c and 6 such that the following hold: 


(a) There is a one to an o map between a (forward) solution 
of (D.1.1) lying RY ) and a (forward) solution of its linearization 
(D.1.3) lying in So" ( 


(b) There is a one to one bicontinuous map between a (forward) solution 
of (D.1.1) lying in AC) and a (forward) solution of (D.1.3) lying 


in Ed (cô). 
Similar statements hold for X$; (6) and X`ọ (6). 
PROOF. See Cushing [24]. 


1A Banach space is a complete space with a norm, where every Cauchy 
sequence converges in the space. 


Appendix E 
The Levin—May Theorem 


To prove Theorem 5.2, we need the following result from Linear Algebra 
[68]: 


P: “The k zeros of a polynomial of degree k > 1 with complex coefficients 
depend continuously upon the coefficients.” 


To make this more precise, let x € C*, and f(x) = (fi (zx), fala), .-., 
fx(x))7 in which f; : C* 3 C, 1 < i < k. The function f is continuous at x 
if each f; is continuous at x, i.e., for each £ > 0 there exists ô > 0 such that if 
lly—a|| < 6, then |fi(x) — fi(y)| < £ where ||- || is a vector norm on C*. Now 
P may be stated intuitively by saying that the function f : CE + C* which 
takes the k coefficients (all but the leading one) of a monic polynomial of 
degree k to the k zeros of the polynomial, is continuous. Precisely, we have 
the following result. 


Lemma E.1 [68]. Let k > 1 and let 
p(x) = a® + ar"! 4+. + apie t ak 


be a polynomial with complex coefficients. Then for every £ > 0, there is a 
ô >0 such that, for any polynomial, 


q(x) = zë + biz"! +--+ bgt + bk 
satisfying 
max |a; — b;| < ô 
1<i<k 
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we have 
ain me [àj — url < €, 
where A1, À2,..., Ag are the zeros of p(x) and u1, u2,..., up are the zeros 


of q(x) in some order, counting multiplicities, and the minimum is taken 
over all permutations T of 1,2,...,k. 


The characteristic equation associated with equation (5.1.18) is given by 
AFH AF 49 =0. 


Since the characteristic roots may, in general, be complex, we may put 
A = re”. This yields the equation 


ph+lei@(b+]) _ pkeiðk 4 qg=0. (E.1) 


The general stability may be mapped out as a function of q and k as follows: 
if, for the dominant eigenvalues, 0 = 0 and r < 1 (A is real and |A| < 1), 
then there is monotonic damping; if, for the dominant eigenvalues, 0 Æ 0, 
r <1 (A is complex, |A| < 1), then there is oscillatory damping; and if 
r >1 (|A| > 1) for any eigenvalue, the zero solution is unstable. 

The next lemma shows that for 


kk 
n= CES (E.2) 
there is monotonic damping if 0 < q < qı. 


Lemma E.2. All solutions of (5.1.20) converge monotonically to the zero 
solution if 


0<q< qı. 


PROOF. To find the region of values of q where solutions of (5.1.20) 
converge monotonically to the zero solution we let 6 = 0 in (E.1). This 
yields 
rtl pki g=0 or 
q=ar® — ritt, (E.3) 
Consider the function q = h(r) = rë — r**1. Clearly, h(0) = h(1) = 0 and 


h(r) > 0 if and only if 0 < r < 1. Moreover, if q = 0, then r = 0 is of 
multiplicity k. Since h’(r) = r*-1(k — (k +1)"), we conclude that: 


i) If0 <r < -&, then h'(r) > 0 and thus q is increasing. 
k+1 
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FIGURE E.1. For q < qı, there are two positive solutions r1, r2 of (E.3). 


(ii) fr = rat then h’(r) = 0 and q attains its maximal value 


enan iG) 
k 
7 isa) Í eal 


kk 
~ (e+ ET 
(iii) If r > ae then h’(r) < 0 and thus q is decreasing and intersects the 


r-axis at r = 1. 


Hence, for every q > 0, there are two positive real solutions rı and rp of 
(E.3) if and only if q < qı (see Figure E.1). As q tends to zero, rı + 0 and 
rg — 1; and as q tends to q1, both roots coalesce to TD: 

It remains to show that the larger root r2 of these two real roots is the 
dominant root for all 0 < q < qı. In fact, we will show that as q increases in 
the range 0 < q < qı, there will be one real root r with magnitude greater 
than Fat but less than 1, and the remaining k roots have magnitude less 


than ae To accomplish this task, it suffices to show that as q increases in 
the interval (0, q1), no characteristic root crosses the circle centered at the 
origin and with radius Rat: To prove this statement we put u = \(k+1)/k 


and p = q/qı in (E.3). This yields 
kut! — (k+ 1)" +p=0. (E.4) 
Notice that a characteristic root À crosses the circle with radius a if 
and only if the corresponding characteristic root u crosses the unit circle. 
If such a crossing occurs, then, by Lemma E.1, there exists a characteristic 
root u = e? of (E.4). Substituting in (E.4) gives 
ke? = (k +1) — pe~**®, 


Hence 


k(cos@ + isin) = k + 1 — p(cos k — isin k0). 
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Equating the real parts in both sides of the equation and similarly for the 
imaginary parts yield 


kcos@ = (k +1) — pcos k0, 
ksin 0 = psin kð. 
Squaring and adding the above two equations yield 
k? = (k +1)? + p? — 2p(k + 1) cos k0, 


2k+1+p? 
2p(k +1) ` 


Since |cos k| < 1, it follows that 


cos k = 


2k+1+p? < 2p(k +1) 
or 


(1—p)(2k+1—p) <0. (E.5) 


Since p = A < 1, both terms in inequality (E.5) are positive and thus we 

have a contradiction. Hence no characteristic root u crosses the unit circle 

and, consequently, no characteristic root À crosses the circle with radius 
k 


EFI: 
This shows that for 0 < k < kı there is a dominant positive real charac- 
k 


teristic root of magnitude between 77; and 1, whereas all the remaining k 


characteristic roots have modules less than aa 


Lemma E.3. If 0<q< q2, where 


kr 
q2 = 2 cos (5) ; (E.6) 


then all solutions converge to the zero solution. 


PRooF. By virtue of Lemma E.2, it suffices to consider the case where 
qı < q < q2. Consider again the function q = h(r) = r! — r+! whose 
derivative is given by h'(r) = r*-1(k — (k + 1)r). For r < 0, the sign of 
h'(r) depends very much on whether k is even or odd. If k is odd, then 
h'(r) > 0 and, consequently, q = h(r) is increasing in the interval (—oo, 0] 
and equation (E.3) has all complex roots. On the other hand, if k is even, 
then h’(r) < 0 and thus A is decreasing on (—oo, 0]. It follows that equation 
(E.3) has one real root and k complex roots. This real root \ = re’? must 
be negative and hence 0 = x. Substituting in (E.1) yields 


=r" rk 4g =0. 
Hence 


rti pk =q. (E.7) 
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Since q < q2 < 2, it follows that r < 1. This implies that the real root is 
between —1 and 0. As q increases, the zero solution becomes unstable the 
first time r exceeds 1. 

Putting r = 1 in (E.1) yields 


e 14 ge **? — 0. (E.8) 
Equivalently, we have 
(cos @ + isin 0) = 1 — q(cos k0 — isin k0). 


Equating the real part in the left side with the real part in the right side 
and similarly for the imaginary part yields 


cos 0 = 1 — q cos k0, 
sin 0 = qsinké. 
Squaring and adding yields 
q = 2 cos kð. (E.9) 
Substituting (E.9) into (E.8) we obtain 
e? = 1 — 2(cos* k8 — i cos kô sin k0) 
= —cos2k0 + isin 2k0 
— e- 2ikð. 
Hence 0 = (2n + 1)r — 2k0, when n is an integer. Solving for 8 yields 
(2n + 1)r 


0 = ——_—. E.1 
2k+1 om) 
By (E.9) we obtain 
(2n + 1l)ka 
=2 ——— j. E.11 
q = 2 cos ( TFN (E.11) 


Note that there may be several distinct values of q given by different values. 
The smallest of these values of q occurs at n = 0: 


kr 
(2k +1)” 
and this defines the upper boundary of the stability region. This is clear 


A 2n+1 _ (2n+1)k _ _2n+1 sa; A A A 
since 15 3k41 — 2(2k-+1) 18 increasing as n increases. This completes 


the proof of the Lemma. 


a= q = 2008 ( 


PROOF OF THEOREM 5.2. Lemma E.3 shows that, for 0 < q < q2, the 
zero solution of (5.1.18) is asymptotically stable. By examining the deriva- 
tive of r with respect to q, we will show that at r = 1, dr/dq > 0. This 
would imply that as q increases, r can only cross the boundary r = 1 
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from below. Consequently, the complex pair of dominant eigenvalues can- 
not reenter the stable region once it leaves it, and so the zero solution of 
(5.1.18) is unstable for all q > q2. 

Equating the real part with the real part and likewise with the imaginary 
part in (E.1) yields 


sin kô 


rene (E.12) 
and 
q = r" cos k0 — r+! cos(k + 1)0 
, ; k0 cos(k + 1)0 sin k0 
= Lo\k cos 
(sin k0)" | mF DaF eime + DOH 
. k k 
(sin k0)" sin 0 
[sin(k + 1)6]*+1 ee) 


If r = 1, we obtain, for (E.12), 
sink@=sin(k+1)0 and cosk@ = —cos(k+1)0 
and hence 


sin k0 = sin k0 cos k + cos kô sin k, 
cos kð = —coskð cos 0 + sin kô sin 8. 


Multiplying the first equation by cos k@ and the second by sin k0 and then 
adding yields 


sin 0 = sin 2k8. 


Multiplying the first equation by sin k0 and the second by cos k0 and then 
subtracting yields 


cos 0 = —cos2kð. 
From (E.12) we have, for r = 1, 


“ = kcot(k0) — (k + 1) cot[(k + 1)°] 
= (2k + 1) cot k0 
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and from (E.13) we have, for r = 1, 
dq _ [sin(k + 1)6]***[k?(sin k0)*~! cos k0 sin 6 + (sin k0)” cos 0] 
dO [sin(k + 1)6]2*+2 
(sin k0)" sin 0 - (k +1)?[sin(k + 1)0]* cos(k + 1)0 
[sin(k + 10262 
k? cosk@sin@ | cos (k + 1)? sin 8 cos(k + 1)0 
[sin(k + 1)6]? © sin(k + 1)0 [sin(k + 1)6]2 
= (2k? + 2k +1) cot k0 — cot 2k0 
( 


1 
2k? + 2k +1) cot kô + 5 (tan k0 — cot k0) 


1 1\? 1 
= («+ 5) cot k0 + z tan kd. 
Clearly, 4 and dr both have the same sign as cot k0, and hence a E d 4 


is positive. This completes the proof. 


Appendix F 


Classical Orthogonal Polynomials 


This is a list of some classical orthogonal polynomials Q,(x), their defi- 
nitions, the corresponding intervals of orthogonality (a,b), and difference 
equations Qn+1ı (£) — (Ant + Br)Qn(x) + CrQn—1(x) = 0. 


Difference 
Name Definition a, b) Equation 
1. Jacobi: P&P (x) 1,1 see (9.5.12), (9.5.15), 
(9.5.16) 
2. Gegenbauer: PY (a) —1,1 An = 2247, Bn =0 
(ultraspherical) (see (9.4.10)) Cr = avin 
3. Legendre: P, (x) = PO.) —1,1 A; = aa; Bn =0 
(see (9.4.9)) Cn = ai 
4. Chebyshev: Tn(x) = cosné, —1,1 An = 2, Bn =0 
(First kind) 6 = cos + (x) Cr =1 
5. Chebyshev: Unita) = Se (—1,1 An = 2, Bn =0 
(Second kind) 6 = cos + (x) Cr=1 
6. Hermite: H, (x) —00,0co) An = 2, Bn =0 
(see (9.4.15)) Cn = 2n 
7. Laguerre: Ly (a) 0,00) An = a a 
(see (9.4.13)) Bn = 
Cn = THI 
8. Charlier: Co (x) 0,00) An =1 
(see (9.5.17)) Bn =-n-a 
Cr =an 
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Appendix G 


Identities and Formulas 


G+) 
So (ele) PN) 


d” m, n qr-k dév 
dx” ae 2 G da”—k drt’ 


) Dee = x)” te D*(1 $ grt 


k 
= (-1)"1-—2)*1+ r)Pn! 


“A (nt+a\ (n+p k n—k 
(a —1)"(a@+1)"™. 
a k ) 
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Answers and Hints to Selected 


Problems 


Exercises 1.1 and 1.2 


9. 38 payments + final payment $52.29 


11. 


13. 


( 

(a) A(n+1)=(14+r)A(n)+T 
(b) $25,000 [(1.008)” — 1] 
$136,283.50 


aes 
15. (a) r=1— (5) 


(b) 2,933 years 


Exercises 1.3 


3. (a) B 


œa— 1 
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7. (i) D(n) = —p(n) +15 
S(n+ 1) = 2p(n) +3 
» = 4, unstable 


P 

1 
p(n+1)=—5p*(n) +1 
P 


Exercises 1.4 


1. (a) y(n +1) = y(n) — ky?’ (n), y(0)=1 
3. (a) y(n + 1) = y(n) + oeod = y(n), y(0) =2 
5. (a) yln+1) = ln) + p(n) + 5 
7 _ _dy(n) 
. y(n+1)= Ayn) 
9. Nonstandard: y(n + 1) = eon 


Euler: y(n + 1) = y(n) + hy?(n) + hn 


Exercises 1.5 


f ; asymptotically stable 


+1: unstable 
3. 0: asymptotically stable 
5. 0: unstable 
7. 0: unstable 
9. Hint: Use L’H6pital’s rule 
1. Hint: Consider monotonic and nonmonotonic functions 
6. (a) from the left 
(b) from the right 


Exercises 1.6 


5. {0,1}: asymptotically stable 
7. |b? — 3ab| < 1 


1 2 
9. 3°3 
11. (b) unstable 
13. f(x) = -zx 
17 gare 
> 4 
_  H+l—~V((met 1-3) — _u+1i+v(u+1(u-3) 
19. tı = , T2 = , 
2u 2u 


Exercises 1.7 


2. Hint: Let a(n) = sin? 0(n) 


Answers and Hints to Selected Problems 


1 
5. Hint: Show that 0 < f'(x) < 1 for x* < x < = 


2 
7. Hint: Show that $f7(2(0)) < 0 
9. Hint: Use a calculator or a computer 
11. Hint: Let y = — ux + tu 


3 
13. c= —- 
3. c 7 


17. xj is unstable 
x3 is asymptotically stable 
x3 is asymptotically stable 
19. «* = 0 is unstable 


Exercises 1.8 


1. There are fixed points x] = 0, 73 = 1, 73 = 9 
W*(2x}) = B(2t) = (-1,1) 
x5 is unstable, —1 is eventually fixed 
9. Hint: Consider three cases: 
(a) 0<p<1 
(b) p=1 
(c) l<p<2 


Exercises 2.1 


9. Hint: Write f(n) = ao + ayn + aon) +--+ ayn 
11. Hint: Use mathematical induction on m 
r? = 7) 4322 42 


13. 2 gt = 4 7¢2 4 628 pr 
a =a + 152 4 252) + 1024 + 2) 


15. Inm- 1) +n{n 1)(n 2) + in(n 1)(n — 2)(n—3) +e 


Exercises 2.2 


1. (a) 0, linearly dependent 


(b) 2(53"*3), linearly independent 
(c) (—1)"*1(27)4”, linearly independent 
(d) 0, linearly dependent 
3. (a) (i) linearly independent 
(ii) cy + con + c3n? 
(b) (i) linearly independent 
(ii) cı cos (+) + cg sin (+) 
(c) (i) linearly dependent 
(ii) no general solutions 
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(d) (i) linearly independent 
(ii) need one more solution 
14. Hint: Consider A (2) aAA wa bee 
u(n) ui(n)ui(n + 1) 
15. Hint: You may take W (no) = 1 or any of your favorite constants, use 
formula (2.2.10) to evaluate W (n) 


Exercises 2.3 


1. (a) x(n +2) —7a(n 
(b) z(n +2) + a(n) 
(c) z(n+4)—10V2r(n+3)+160x(n+2)—250V2z(n+1)+625zr(n) = 0 
(d) z(n +1) — 21a(n 4+ 2) + 49r(n + 1) — 343z(n) = 0 
(e) x(n +4) — 4r(n +3) + 6z(n + 2) — 4r(n + 1)+ z(n)=0 
3. c14” le C2(—4)” 
5. c13” + con3” + c32” cos > + c42” sin > 


7. &12”/2 cos > + ¢92”/? sin > + ¢32"/2n cos > + c42”/2n sin > 


11. (d) Tn : 1,%,2z? = 1 
Un : 1, 22,407 — 1 
18. (a) Hint: aP} = 1 mod p if a and p are relatively prime 
21. Hint: D(n) = bD(n — 1) — a?D(n — 2) 
„Sin(n + 1)0 
: sin 6 


zi 


6 = cos™! ( — 
cos 2q 


Exercises 2.4 


1 1 ie 
. nt 
zi £ 1 1 
Nn y 2 3 
Ge hea 1a Gg 
5 cos (“") 1 cos (27) 
- 5008 | > zrs | 
T e Tn + 8n? i 
nT nT 
9. 2(3" ( ) ( E 3” 
a5 95 88k) a a ag” 
11. c1(—7) + co( 1) + a7” 243” 
15. y(2) =1 
y(3 + 4n) = y(44+4n)=0, n=0,1,2,3,... 
y(5 + 4n) = y(6 + 4n) = —1 n=0,1,2,3,... 
—n? 3 1 
17. y(n) = Z. pe +a + b(6") 
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Exercises 2.5 


1. 
3. 
13. 


repelling, oscillatory 
attracting, oscillatory 
(i) oscillatory 
(ii) oscillate to oo 
(iii) y* is asymptotically stable 


Exercises 2.6 


7. 
9. 
11. 
13. 
15. 


3 c (3)” + €2(—1)” 
. 1/(c- n) 


3(1 + ¢(2/3)"*") 
1+ ¢(2/3)” 

Loe 

sin? (c2”) 

er?" y(0) 

cot(c2”) 

sin(c2”) 


Exercises 2.7 


1. 


11. 


15. 


(a) si(n+ 2) — oyası(n + 1) — o?ypA — a)sı (n) = 0 


(b) y > 50 
(a) F(n+2) = F(n+1)+2F(n) 
(b) 3,5,11 
(ii) Hint: Let $10 equal 1 unit, n = 5, N = 10 
13.9298 
9.66 x 10235 
(a) Y(n +3) — (a, +1)Y (n +2) — (ag — a1ı)Y (n + 1) + aY (n) 
(b) Y(n) =e, +c aad (? £) Ha + en 
(a) M(n) = M(no)2”~° 
(b) c=1 


Exercises 3.1 


grt "E 3r 3r = Qn 


grt} _ 9(3") 2(3") — 2” 


1 1 
ntl _ n ~2 gntl ~ _ *aQn 
3 + 5 5° 
1 1 
92)" n 2—2” aya Tan 
(=2) "423 5 + 58 


—277 1 4(3") 4-2"? 14 2/3") 
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1 
pert seed) 
5. | 3 
gntl 
3— gntl 
7. | 20-2) 
2(—1 +2”) 


10. (a) Hint: Use (3.1.18) 


12. Hint: If Ay = Ag = A and A” = ag + ayA + apr? Ga eae eta ap_1r*—?, 


differentiate to get another equation nr"-+ = ay + 2a2À +--> 


1)ap—1A%7? 
gn+1 = 3n 3n ft gn 
arti — 9(3")  2(3") — 2” 


(ii) Same as Problem 3 
0 1 0 


0 0 1 
15. (a) a i 
2 2 
(b) (2/5, 1/5) 


Exercises 3.2 


re oe 
16 4° {6 
9. 
aa E a E 
0% tt Me 
16 4° 16 


15. a1(—2)” + aọ(—6)” 
17. a, + a24” + 3nd” 


19. ay (54) + a2 (=) 


Exercises 3.3 


i gntl = 4” 

"\ 24”) 
(1)! + 6”] 
3 


3: is 
SCi 6 
7. +5 
0 
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0 1 1 
5. &2” | 1} +e | -1 |] +33” | 7 
0 0 


i |- casin T + cs cos ry 


9. 27/2 | C2 cos = c3 sin m] 


cy +2? le cos v= + c3 sin m] 


2” n2”! n(n -= 1)? 
b qo 2” 2 
0 0 2” 
2 1 —2 gn 3” ilk mn = 1) 3r-2 
-1 0 1 
(c) 2 0 gn n3” 1 
3 
Zh AaS 
9 2 
1 2 0 
3 
p o <5 
2 0 0 0 
0 2” n n(n-—1)2? 
(d) 
0 0 2” n2” 
0 0 0 2% 
c1 (2” — n2"—") + egn2” + c3(3n?2"! + 3n(n — 1)2”73) 
13. —cyn2”—? + c22” (1 — n) — 3cegn(n — 1)2”74 
c32” 


19. Hint: Use the similarity matrix P = diag(1,a,a7,...,a*~') 


Exercises 3.4 
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5. Hint: First change the equation to a system and then show that the 


monodromy matrix is equal to ®(N) 
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Exercises 3.5 
3. Hint: Consider ATE = £ with € = (1,1,...,1)7 
5. (i) Hint: Consider (I — A)x = 0 
(ii) Hint: Use (I — A (I + A+ A*4+---+ A!) =I- A” 
5/9 
7. | 2/9 
2/9 
9. 0.25 
11. 177.78; 272.22 
13. 0 


Exercises 4.1 
1. (a) 3, 3,3 
(b) 6, 4, 33 
(c) 6, 7, 5.21 
3. Hint: Use D = diag(1, €, €) 


Exercises 4.3 


1. (a) unstable 
) asymptotically stable 
(c) asymptotically stable 


1 

3 0 
a) uniformly stable 

) 

) 

) 


w 
er 
gi 
£ D| o 
= | D 
— 
He] OTD] = 


no conclusion 
asymptotically stable 
no conclusion 


Exercises 4.4 


1. (a) asymptotically stable 
(b) unstable 
(c) unstable 
(d) asymptotically stable 
3. unstable 
5. stable, but not asymptotically stable 
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Exercises 4.5 


1. Hint: Let V(x) = x? + x3 


13. 


The fixed point (0,0) is globally asymptotically stable. 


Hint: Let V = xy and then use Problem 11 


Exercises 4.6 


1. 
3. 


10. 


12. 


exponentially stable 


2 2 
1 
Hint: V = a? (x — =) +b? (ez — =) 
V2 V2 


1 1 
The equilibrium point | —=, —= } is unstable. The equilibrium point 
q P V2 V2 q P 


( > : is unstable 
=e OS 1s un a 
V2? v2 

0 1 
(a) JO], |1 


0 0 
(b) undetermined, unstable 


. unstable 
. if |a| < 1 and |b| < 1, then the zero solution is asymptotically stable 


N(y+ 8) 


, 
a 


a) 

a) (N,0), BN | 

(0) mo ( aly +8) 

(b) The first point is asymptotically stable if 
ipa 

Yt 
Hint: Use the variation of constant formula (3.2.12) and then use 
Theorem 8.12 


< 1 and unstable 
y+ 


> 1. The second point is asymptotically stable. 


Exercises 5.1 and 5.2 


3. 
11. 


12. 


l<a< 2.62 

Hint: Let g(z) = pyz*-1+poz*-2 +--+ + pz, and f(z) = z* on the unit 
disk 

Hint: Let f(z) = piz*7!, g(z) = z* — poz*-? + --- + pp, on the circle 
of radius 1 + £, for some appropriate £ > 0 


Exercises 5.3 


1. 
6. 


7. 


1 
a b < 0.78 
Hint: Make the change of variable N(n) = N*e?™ 


ee)", 1 V0 Sa) ayh 


k k i=0 i=0 
25 b; 23> b; 
i=0 i=0 
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Exercises 6.1 
z(z — cos w) 
1. 

(a) z? —2zcosw+1’ 
2(z? — 1)sin2 
(22 — 2zcos2 +1)?’ 

z 


\z| >1 


|z| >1 


ee 1 
© gy 14> 
_ 2 
OIE: Heal 
z(z — a) 
5 (z+ 1)?z"-3 
z” —1 
7. Hint: Use mathematical induction on k 
1 
. oo 
15. Hint: y(n) — y(n — 1) = nz(n) 


27 sinw 
(z — a)(z? — 2z cosw + 1) 


17. (a) 


z?(z — cosw) 


») (z — 1)(z? — 2z cosw + 1) 


Exercises 6.2 

a) 2/3[2-" — 1] 

b) —1/7(—2)" + 1/7n(—2)" + 6/7 
a) (—2)""9(8n? — n) 

b) 2-"+1 + 2sin (S52) 

1 


Pye) flava 
“ /5 2 2 
Zin) 
11. Hint: Replace n by n+ 1 


l-—e 1 
1)? 
jae" z=) e ) 


. 
( 
( 
( 


Exercises 6.3 


1. x(n) = ZON + 2(4”)] 


unstable 
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3. Problem 1. unstable 
Problem 2. uniformly stable 
5. unstable 


Exercises 6.4 


1. asymptotically stable 
3. not asymptotically stable 
4. Hint: Sg na” = oey fora <1, are = oe 


Exercises 6.5 


3. asymptotically stable 
5. uniformly stable 


Exercises 6.6 


4. Hint: See Miigoren 4.9 i 
5. (a) x(n) = -=(-3)” + 7e 


a 
G- v2) 
2 


(1+ v2)2”7! + Cae 0 


1+ 52") +50") 


Exercises 7.1 


5. Hint: Use Theorem 7.3 
7. Hint: Consider the function f(A) = AFT! — AF + p and show that it 
attains its minimum when A = (k — 1)/k 


Exercises 7.2 


8. Hint: Use Problem 7 

9. Hint: Use Problem 7 
12. Hint: Use Theorem 7.16 
14. Hint: Use Problem 13 
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Exercises 7.3 


3. Hint: Let s(n) = ae¥™ and then use Theorem 7.18 

4. Hint: Let z(n) = x*e¥”) and then apply Theorem 7.19 

6. Hint: Let z(n) = x(n Wate +1) and then mimic the proof of Theorem 
7.18 

7. Hint: Follow the hint in Problem 6 


Exercises 8.1 


12. Hint: Use f(t) = (14+ 0(1 9 (t ) 
14. (c) Hint: Show that {7° <— dt < 
15. Hint: Use integration by parts 
16. Hint: Write 0"_, kë = nefi + CRT 4...4 4] 


n” 


—2 


Exercises 8.2 


14. Hint: Notice first that log [];" Sed + u(i)) = yaa no log(1 + u(i)) 
15. (c) Hint: Use the mean value theorem 
(e) Hint: Substitute (8.2.19) into (8.2.17) 
(£) Hint: Solve (8.2.28) and then use Problem 14 
17. 21(n) ~ n?, za(n) ~ qao n > 00 
20. Hint: Let y(n) = x(n + 1)/z(n) 


Exercises 8.4 


12. Hint: Let x(n) = (-1)” (it no) z(n) 


Jj=no 


Exercises 8.5 


7. Hint: Reverse the order of summation on the left-hand side as in Figure 
8.2 
10. Hint: Use Problem 8 and then let A(n) = x2(n)Ay(n) — Axo(n)y(n) 
and B(n) = Aai(n)y(n) — x1(n)Ay(n), then mimic the proof of 
Problem 8 


Exercises 9.3 


9. (x,y) = (37,47) + m(48, 61) 
10. Hint: Consider the continued fraction representation of v£ 


— A(m—1)+A(M)Em+ 
Then Vl = Sin D Bee 


Em+1 = 2bo + oo pe ye S Vet bo; 
1 


show that 
A(m)(A(m) — B(m)bo) — B(m)(B(m)é — A(m)bo) = (-1I)™* 
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or 
A?(m) — €B?(m) = (-1)""} 


Conclude that x = A(m), y = B(m) is a solution of Pell’s equation if 
m is odd, and if m is even, x = A(2m+ 1), y = B(2m-+) is a solution 
11. c=8,y=3 


Exercises 9.4 and 9.5 


5. (n +1)P¥, (x) = 2(v + nje PY (x) — (2v +n — 1)P¥_ (2) 
6. (n+1)L3 (£) = (2n +a +1- x)Lg (x) — (n+ a)L2_,(2) 
7. An4i(x) = 21 Hn (£) — 2nHn-1 (£) 


9. Jn41(2) = (22) Jn(z) — In—1(2) 
12. Hint: Use (9.5.18) and let u > x 


Exercises 9.6 

7. Hint: Use the Cauchy integral formula: 45 (1—2?)" = 24 $, she dt 
Exercises 10.1 and 10.2 
1 -2 
0 
3. Since A is diagonal and B has a row of zeros then, by inspection, the 


system is not completely controllable 
5. rank(W) = 4 < 5, the system is not completely controllable 


1. W = , |W] = 1 #0, the system is completely controllable 


l1 az + a22 
a11 + Q12 


l air +412 
11. W = , |W] = a21 +a22 — a11 — a12 Æ 0 thus a22 + a21 F 


Exercises 10.3 


0 0 1/4(a +b 
is (a) V= wie te sige E O E 
4 y(1) 1/2b 
1 
b) V 5 i ,rank(V) = 1 < 2, the system is not observable 
1 a+b 
3. W = ener |W] = -(a+6)+c+4+d ¥ 0. Thus, for a system 
c 


to be completely controllable a + b # c + d, and for a system to be 
1 0 

completely observable, V = | i |V| =b40 
a 


5. rank(V) = 4, the system is not completely observable 
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Exercises 10.4 


1. K = [-0.1166 —0.6982] 
3. K= [—1.8599 0.5293 2.8599] 
5. Hint: Put the equation into a system form 


Exercises 10.5 


0.875 


—1.125 
3. unsolvable 


1. E= 


Maple Programs 


(I) Solution of scalar difference equations and systems of difference 
equations using rsolve 


> rsolve({x(n+1)-x(n) /(n+1)=1/ (n+1)!,x(0)=1},x); 
n+1 
T(n+ 1) 


> rsolve({x(n+1)=2*x(n)+y(n) , y(nt+1)=2*y(n) ,x(0)=a,y(0)=b}, 
{x,y}); 


1 
{y(n) = 62”, a(n) = 502" + 2”a} 
> rsolve(x(n+2)-5*x (n+1)+6*x(n)=0,x) ; 


—(2x(0) — x(1))3” — (—32(0) + x(1))2” 
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Cobweb Program 
>#Cobweb Program 


>#Call as: cobweb(F, n, s, l, u) 
>#Where: F: The one parameter function 


># n: The number of iterations to be performed 

># s: The initial value of x with which to start 

># 1: The lower bound value for x and y 

># u: The upper bound value for x and y 

>cobweb:=proc(function, iterations, initial, lowerbound, 
upperbound) 


>local F, n, s, u, i, y, G, l; 

>F:=function; 

>n:=iterations; 

>s:=initial; 

>l:=lowerbound; 

>u:=upperbound; 

>with(plottools) 

>y:=eval (subs (x=s,F)); 

>G:=[line([1,1], [u,u]), line([s,0], [s,y]), 
plot (F,x=1..u,color=black)] ; 

>for i from 1 to n do 

> G:=[Lop(G), line([s,y], [y,y]))]; 

> s:=y; 

> y:=evalf (subs (x=s,F)); 

> G:=[op(G), line([s,s], [s,y])]; 

>od 

>plots [display] (G,tickmarks=[0,0]); 

>end 


> # Example: draw the cobweb diagram of the function 
> # F(x)=3.7*x*(1-x) with initial point 0.1. 
>cobweb(3.7*x*(1-x) ,10,0.1,0.1); 
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Bifurcation Diagram Program 


>bifur(c*x*(1-x), 3.57, 4, 100, 50, .01, .5, 0, 1); 
furcation Diagram Program 

# Bifurcation Diagram Program 

# Call as: bifur(F, 1, r, N, T, d, s, b, t) 

# 

Where: 

The one parameter function in terms of c and x 
The left bound on the graph 

The right bound on the graph 

The number of iterations to perform 
The number of iterations to discard 
The step size of the parameter (c) 
The value of x 

The bottom bound on the graph 

The top bound on the graph 


tounareH 2H rem 


# 
# 
# 
# 
# 
# 
# 
# 
# 
# 
# 


VVVVVVV VV VV VV VV 


bifur:=proc(function, left, right, iterations, discard, 
step, start, bottom, top) 


> local F, 1, r, N, T, d, s, t, i, p, b, j, k, G; 
> F:=function; 

> l:=left; 

> r:=right; 

> N:=iterations; 

> T:=discard; 

> d:=step; 

> s:=start; 

> t:=top; 

> b:=bottom; G:=[]; 

> with(plottools): 

> for i from 1 by d*(r-1) to r do 

> P:=s; 

> for j to T do 

> p:=evalf(subs(x=p, c=i, F)); 
> od; 

> for k to N do 

> p:=evalf(subs(x=p, c=i, F)); 
> G:=[op(G), point([i,p])]; 

> od; 

> od; 


> plots[display](G, axes=boxed, symbol=POINT, 
view=[l..r, b..t]); 
> end: 
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> # Example: Draw the graph of F(x)=c*x*(1-x), where c is 
> # between 3.5 and 4 and initial point is 0.5. 
> bifur(c*x*(1-x) ,3.5,4,200,50,.01,.5,0,1); 


[i T T T T 


Maple Programs 


Phase Space Diagram with Four Initial Points 


# 

Where: 

The 
The 
The 
The 
The 
The 


B NS K <a Ee 


# 
# 
# 
# 
# 
# 
# 
# 


VVVV VV VV VV NM NV 


# Phase Space Diagram Program (with 4 initial points) 
# Call as: phase4(A, x, y, Z, v, n) 


matrix entries where f(x)=Ax 
initial point (v1,v2) 

initial point (x1,x2) 

initial point (y1,y2) 

initial point (z1,z2) 

number of iterations to perform 


phase4:=proc(matrix11, matrix12, matrix21, matrix22, 
initiali, initial2, initial3, initial4, initial5, initial6, 


initial7, initial8, iterations) 


> local A, x, n, G, F, H, J, x1, x2, i, x3, x4, w1, w2, y3, 


y4, z1, z2, z3, 24, y, Z, vi, v2, v3, v4, v, K; 


> A:=array(1..2,1. 


.2, [[matrixi1,matrixi2], 


(matrix21,matrix22]]); 


> x:=array(1..2,1. 
y:=array(1..2, 1. 
z:=array(1..2, 1. 
vi=array(1..2, 1. 
> n:=iterations; 
> 


.1, [[initiali] , [initial2]]); 


.1, [[initial3] , [initial4]]); 
.1, [[initial5] , [initial6]]); 
.1, Clinitial7] , [initials]]); 
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x1:=x[1,1]; x2:=x[2,1]; w1:=y[1,1]; w2:=y[2,1]; z1:=z[1,1]; 
z2:=z[2,1]; vi:=v[1,1]; v2:=v[2,1]; 


> G:=[]; H:=[]; J: 
> with(plottools): 
> for i from 1 to 


=[]; K:=[]; 


n do 


> F:=array(1..2, 1..1, [[(A[1,1]*x1)+(A[1,2]*x2)], 
[CA[2,1]*x1)+(A[2,2]*x2)]]); 

> x3:=F[1,1]; x4:=F[2,1]; 

> G:=[op(G), line([x1,x2], [x3,x4])]; 

> x1:=x3; x2:=x4; 

> F:=array(1..2, 1..1, [[(A[1,1]*w1)+(A[1,2]*w2)], 
[(A[2,1]*w1)+(A[2,2]*w2)]]); 

> y3:=F[1,1]; y4:=F(2,1]; 

> H:=[op(H), line([wi,w2], [y3,y4])]; 

> wi:=y3; w2:=y4; 

> F:=array(1..2, 1..1, [[(A[1,1]*z1)+(A[1,2]*z2)], 
[(A[2, 1] *z1)+(A[2,2]*z2)]]); 

> 23:=F[1,1]; z4:=F[2,1]; 

> J:=[Lop(J), line([z1,z2], [z3,z4])]; 


> zZ1:=23; z22:=z4; 


522 Maple Programs 


> F:=array(1..2, 1..1, [[(A[1,1]*v1)+(A[1,2]*v2)], 
[(A[2, 1] *v1)+(A[2,2]*v2)]]); 
> v3:=F[1,1]; v4:=F[2,1]; 

K:=[op(K), line([v1,v2], [v3,v4])]; 

vi:=v3; v2:=v4; 
od; 
plots [display] (G,H,J,K,tickmarks=[0,0] ,color=black) ; 
end: 


VVVV MV 


Vv 


# Example: Draw the phase space diagram of the system 
# x(m+1)=A*x(n) where A=array(2,0,0,0.5). 
phase4(2,0,0,.5,1,3,-1,3,-1,-3,1,-3,6) ; 


Vv 
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uniformly attracting, 176 
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uniqueness, 66 

uniqueness of solutions, 125 

unit impulse sequence, 276 

unitary matrices, 142 

unstable, 11, 176 

unstable fixed point, 43 
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unstable limit cycle, 211 
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unstable subspaces, 487 
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variation of constants formula, 130, 
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variation of constants parameters, 
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variation of V, 204 
vector space, 73 
Volterra difference equation, 294 
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Volterra integrodifferential 
equation, 291 
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Volterra systems, 299 


Weak Poincaré type (WP), 390 
weakly monotonic, 263 
Weierstrass M-test, 354 

whale populations, 258 

Wimp, 346, 423 
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Wronskian, 67 
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Z-transform pairs, 311 

Z-transform of the periodic 
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transform, 308 
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zero-order hold, 431 
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